Abstractive Summarization on SciTLDR Abstracts
43.8ROUGE-1CATTS
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CATTSFine-tuned=true, BLooP=false2026.03 | 43.8 | 20.9 | 35.5 | — | — | |
| BARTFine-tuned=true, BLooP=false2026.03 | 43.3 | 20.8 | 35 | — | — | |
| Gemma 2 + BLooPZero-shot=true, BLooP=true2026.03 | 37.05 | 11.72 | 32.65 | -4.08 | 1.98 | |
| Mistral + BLooPZero-shot=true, BLooP=true2026.03 | 36.45 | 11.41 | 31.99 | -4.08 | 1.93 | |
| Gemma 2Zero-shot=true, BLooP=false2026.03 | 36.39 | 10.66 | 31.75 | -4.11 | 1.88 | |
| Llama 3.1 + BLooPZero-shot=true, BLooP=true2026.03 | 36.12 | 11.58 | 31.32 | -4.18 | 1.78 | |
| Llama 3.1Zero-shot=true, BLooP=false2026.03 | 35.42 | 10.94 | 30.44 | -4.23 | 1.68 | |
| MistralZero-shot=true, BLooP=false2026.03 | 35.33 | 9.87 | 30.71 | -4.14 | 1.79 |