Abstractive Summarization on SciTLDR Full Text
36.92ROUGE-1Gemma 2
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Gemma 2Zero-shot=true, BLooP=false2026.03 | 36.92 | 11.76 | 32.31 | -4.09 | 1.9 | |
| Gemma 2 + BLooPZero-shot=true, BLooP=true2026.03 | 36.54 | 11.87 | 32.15 | -4.06 | 1.98 | |
| MistralZero-shot=true, BLooP=false2026.03 | 36.38 | 11.46 | 32.07 | -4.08 | 1.94 | |
| Llama 3.1Zero-shot=true, BLooP=false2026.03 | 35.95 | 11.23 | 31.83 | -4.09 | 1.98 | |
| Mistral + BLooPZero-shot=true, BLooP=true2026.03 | 35.91 | 11.68 | 31.59 | -4.05 | 2.01 | |
| Llama 3.1 + BLooPZero-shot=true, BLooP=true2026.03 | 35.56 | 11.27 | 31.42 | -4.06 | 2.04 |