News Summarization on CNN/DM (ROUGE, BARTScore, BS Prob)
44.59ROUGE-1PROM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PROMPseudo-summary pre-training=true, Fine-tuning=true2026.03 | 44.59 | 21.66 | 41.46 | — | — | |
| PEGASUSPseudo-summary pre-training=true, Fine-tuning=true2026.03 | 44.17 | 21.47 | 41.11 | — | — | |
| Llama 3.1 + BLooPZero-shot=true, with BLooP=true2026.03 | 40.35 | 18.12 | 36.71 | -3.39 | 3.99 | |
| Llama 3.1Zero-shot=true2026.03 | 40.16 | 16.99 | 36.19 | -3.44 | 3.73 | |
| Pointer-GenFine-tuning=true2026.03 | 39.53 | 17.28 | 36.38 | — | — | |
| WikiTransferPseudo-summary pre-training=true2026.03 | 39.11 | 17.25 | 35.73 | — | — | |
| TEDPseudo-summary pre-training=true2026.03 | 38.38 | 16.49 | 35.08 | — | — | |
| Mistral + BLooPZero-shot=true, with BLooP=true2026.03 | 37.99 | 16.21 | 34.44 | -3.33 | 4.18 | |
| PROMPseudo-summary pre-training=true2026.03 | 37.87 | 15.91 | 34.16 | — | — | |
| MistralZero-shot=true2026.03 | 36.77 | 13.52 | 32.94 | -3.43 | 3.72 | |
| Gemma 2Zero-shot=true2026.03 | 35.29 | 13.1 | 32.18 | -3.43 | 3.74 | |
| Gemma 2 + BLooPZero-shot=true, with BLooP=true2026.03 | 34.98 | 15.07 | 32.12 | -3.32 | 4.29 | |
| PEGASUSPseudo-summary pre-training=true2026.03 | 32.9 | 13.28 | 29.38 | — | — |