News Summarization on CCSum
56ROUGE-LFLAN-T5
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FLAN-T5Fine-tuning=true2026.03 | 56 | — | — | — | — | |
| GPT 3.5Zero-shot=true2026.03 | 41.5 | — | — | — | — | |
| Llama 3.1 + BLooPZero-shot=true, with BLooP=true2026.03 | 41.06 | 47.36 | 30.28 | -1.92 | 16.8 | |
| Llama 3.1Zero-shot=true2026.03 | 39.8 | 46.97 | 28.19 | -2.03 | 15.04 | |
| MixtralZero-shot=true2026.03 | 38.1 | — | — | — | — | |
| Mistral + BLooPZero-shot=true, with BLooP=true2026.03 | 32.8 | 38.74 | 22.32 | -2.01 | 15.18 | |
| MistralZero-shot=true2026.03 | 30.7 | 37.68 | 18.32 | -2.17 | 12.95 | |
| Gemma 2 + BLooPZero-shot=true, with BLooP=true2026.03 | 29.37 | 34.3 | 19.38 | -2.08 | 14.39 | |
| Gemma 2Zero-shot=true2026.03 | 28.56 | 34.24 | 16.58 | -2.22 | 12.34 | |
| PEGASUSPseudo-summary pre-training=true2026.03 | 28 | — | — | — | — |