Text Generation on XSum (ROUGE metrics)
34.6ROUGE-1FLAN-T5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FLAN-T5autoregressive=true2025.05 | 34.6 | 72.7 | 12.9 | 27.2 | |
| SMOOTHIEimplementation=original2025.05 | 33.7 | 68.8 | 11.1 | 26 | |
| Embeddingimplementation=re-implemented2025.05 | 32.1 | 68.2 | 10.1 | 24.6 | |
| TEncDM2025.05 | 31.9 | 69.9 | 10.7 | 25.3 | |
| AR-Diffusion2025.05 | 31.7 | — | 10.1 | 24.7 | |
| Transformerautoregressive=true2025.05 | 30.5 | — | 10.4 | 24.2 | |
| Simpleximplementation=re-implemented2025.05 | 29.6 | 63.8 | 8.5 | 23 | |
| GENIE2025.05 | 29.3 | — | 8.3 | 21.9 | |
| SeqDiffuSeqreproduced=true2025.05 | 28.6 | 61.8 | 6.7 | 21.3 | |
| GPT-2autoregressive=true, reproduced=true2025.05 | 28.3 | 69 | 8.2 | 21.8 | |
| MDLMreproduced=true2025.05 | 27.9 | 62.1 | 7.7 | 21.1 | |
| DiffuSeq2025.05 | 18.9 | 46.8 | 1.3 | 13.6 |