Abstractive Summarization on CNN/DailyMail (test)
40.19ROUGE-LSpecDec
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SpecDeck=252025.08 | 40.19 | 43.11 | 20.43 | 5.1 | — | — | — | |
| AR BART-baseBeam size=52025.08 | 40.15 | 43.08 | 20.41 | 1 | — | — | — | |
| AR BART-baseBeam size=12025.08 | 39.96 | 43 | 20.28 | 1.1 | — | — | — | |
| BRIOReference=[25]2026.06 | 39.21 | — | — | — | 87.1 | 11.7 | 46 | |
| CM-ASD2025.08 | 38.1 | 41.9 | 18.3 | 4 | — | — | — | |
| PEGASUS-xsumReference=[25]2026.06 | 36.65 | — | — | — | 86.5 | 12.2 | 45.11 | |
| RewriteNAT2025.08 | 35.74 | 39.12 | 16.24 | 3.1 | — | — | — | |
| DAT2025.08 | 35.43 | 38.95 | 16.11 | 14.1 | — | — | — | |
| CMLM2025.08 | 34.22 | 37.59 | 15.17 | 1.8 | — | — | — | |
| T0Reference=[25]2026.06 | 33.95 | — | — | — | 86.3 | 8.9 | 43.05 | |
| GLAT+CTC2025.08 | 33.69 | 37.76 | 14.08 | 14.5 | — | — | — | |
| MASFReference=(current paper)2026.06 | 32.75 | — | — | — | 88.63 | 16 | 45.8 | |
| DAMBReference=[26]2026.06 | 30.5 | — | — | — | 88.7 | — | — | |
| GPT3-D2Reference=[25]2026.06 | 28.08 | — | — | — | 85.9 | 6.6 | 40.19 | |
| text-davinci-003Reference=[4]2026.06 | 25.5 | — | — | — | 86.8 | 48.96 | 53.75 | |
| BART-CNN-largeReference=[21]2026.06 | 24.58 | — | — | — | — | 6.68 | — | |
| T5-largeReference=[21]2026.06 | 24.42 | — | — | — | — | 5.75 | — | |
| T5-baseReference=[21]2026.06 | 23.54 | — | — | — | — | 5.65 | — | |
| PEGASUS-largeReference=[21]2026.06 | 21.73 | — | — | — | — | 5.01 | — | |
| mpt-7b-instructReference=[4]2026.06 | 21.3 | — | — | — | 85.1 | 9.35 | 35.46 | |
| falcon-7b-instructReference=[4]2026.06 | 19.7 | — | — | — | 83.8 | 9.47 | 34.5 |