Title Generation on SpringerSSAT (test)
96.7Precision (s^NU)T5-base
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| T5-baseFine-tuned=true, Fine-tuning set=SpringerSSAT training set2026.06 | 96.7 | 96.68 | 48.76 | 50.04 | 46.38 | 48.5 | 49.13 | 45.91 | — | — | — | — | — | — | — | |
| PEGASUS-largeFine-tuned=true, Fine-tuning set=SpringerSSAT training set2026.06 | 95.23 | 95.22 | 52.36 | 50.74 | 48.92 | 52.16 | 50.32 | 48.67 | — | — | — | — | — | — | — | |
| BART-baseFine-tuned=true, Fine-tuning set=SpringerSSAT training set2026.06 | 92.98 | 92.93 | 49.55 | 45.06 | 44.82 | 49.32 | 44.56 | 44.55 | — | — | — | — | — | — | — | |
| LLaMA-3-8BFine-tuned=true, Fine-tuning set=SpringerSSAT training set2026.06 | 81.03 | 80.87 | 51.95 | 41.94 | 43.85 | 51.68 | 41.96 | 43.77 | — | — | — | — | — | — | — | |
| LLaMA-3-8B*Fine-tuned=false, Mode=without fine-tuning2026.06 | 57.84 | 57.08 | 28.93 | 49.42 | 32.66 | 27.95 | 45.58 | 31.11 | — | — | — | — | — | — | — | |
| BART-baseFine-tuned=true2026.06 | — | — | — | — | — | — | — | — | 39.1 | 18.38 | 32.57 | 31.88 | 27.95 | 88.48 | 71.8 | |
| LLaMA-3-8BFine-tuned=true2026.06 | — | — | — | — | — | — | — | — | 35.22 | 15.96 | 30.31 | 29.07 | 25.96 | 88.23 | 71.19 | |
| LLaMA-3-8B*Fine-tuned=false, Note=Zero-shot mode2026.06 | — | — | — | — | — | — | — | — | 23.3 | 8.61 | 18.83 | 24.92 | 8.76 | 85.53 | 61.05 | |
| PEGASUS-largeFine-tuned=true2026.06 | — | — | — | — | — | — | — | — | 42.24 | 20.52 | 35.32 | 34.87 | 29.97 | 88.71 | 72.43 | |
| T5-baseFine-tuned=true2026.06 | — | — | — | — | — | — | — | — | 40.34 | 19.92 | 33.7 | 34.49 | 28.01 | 88.43 | 71.6 |