News Summarization on Multi-News (ROUGE, BARTScore)
55ROUGE-1MoA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MoAType=TF2026.06 | 55 | 24.9 | 29.4 | — | — | |
| PEGASUSPseudo-summary pre-training=true, Fine-tuning=true2026.03 | 47.52 | 18.72 | 24.91 | — | — | |
| CentrumType=FT2026.06 | 46 | 17 | 23 | — | — | |
| CentrumPseudo-summary pre-training=true, Fine-tuning=true2026.03 | 45.7 | 16.8 | 23.2 | — | — | |
| SRI+beamType=TF2026.06 | 44 | 15 | 19 | — | — | |
| GLIMMER-TTRType=TF2026.06 | 44 | 15 | 21 | — | — | |
| CentrumPseudo-summary pre-training=true2026.03 | 43.5 | 15.7 | 22.4 | — | — | |
| PRIMERAType=FT2026.06 | 42 | 14 | 21 | — | — | |
| PEGASUSPseudo-summary pre-training=true2026.03 | 36.54 | 10.52 | 18.67 | — | — | |
| PEGASUSType=FT2026.06 | 32 | 10 | 17 | — | — | |
| Gemma 2 + BLooPZero-shot=true, with BLooP=true2026.03 | 31.98 | 9.93 | 20.85 | -3.31 | 4.01 | |
| Gemma 2Zero-shot=true2026.03 | 31.02 | 9.08 | 20.68 | -3.32 | 3.93 | |
| Mistral + BLooPZero-shot=true, with BLooP=true2026.03 | 29.67 | 9.37 | 19.47 | -3.33 | 3.92 | |
| Llama 3.1 + BLooPZero-shot=true, with BLooP=true2026.03 | 29.59 | 9.55 | 19.44 | -3.34 | 3.86 | |
| Llama 3.1Zero-shot=true2026.03 | 28.73 | 9.31 | 18.98 | -3.34 | 3.85 | |
| MistralZero-shot=true2026.03 | 28.12 | 8.49 | 18.71 | -3.33 | 3.88 | |
| LEDType=FT2026.06 | 17 | 4 | 10 | — | — |