Title Generation on CSPubSum (test)
98.13Precision (s^NU)PEGASUS-large
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PEGASUS-largeFine-tuned=true2026.06 | 98.13 | 98.08 | 60.39 | 56.49 | 55.39 | 60.17 | 56.21 | 55.18 | — | — | — | — | — | — | — | |
| BART-baseFine-tuned=true2026.06 | 97.44 | 97.39 | 61.52 | 52.84 | 53.91 | 61.35 | 52.56 | 53.72 | — | — | — | — | — | — | — | |
| T5-baseFine-tuned=true2026.06 | 97.1 | 97.08 | 59.3 | 51.82 | 52.38 | 59.08 | 51.58 | 52.17 | — | — | — | — | — | — | — | |
| GPT-3.5-turboFine-tuned=false2026.06 | 92.73 | 92.73 | 59.79 | 50.95 | 51.7 | 59.79 | 51.01 | 51.74 | — | — | — | — | — | — | — | |
| LLaMA-3-8BFine-tuned=true2026.06 | 78.95 | 78.93 | 57.54 | 46.99 | 49.12 | 57.44 | 46.97 | 49.08 | — | — | — | — | — | — | — | |
| LLaMA-3-8BFine-tuned=false2026.06 | 67.7 | 67.7 | 39.19 | 40.48 | 36.81 | 38.96 | 39.98 | 36.48 | — | — | — | — | — | — | — | |
| BART-baseFine-tuning=Yes2026.06 | — | — | — | — | — | — | — | — | 45.7 | 25.97 | 40.11 | 39.37 | 39.75 | 90.21 | 76.89 | |
| GPT-3.5-turboFine-tuning=No2026.06 | — | — | — | — | — | — | — | — | 42.81 | 21.16 | 36.55 | 35.12 | 37.39 | 88.66 | 76.28 | |
| LLaMA-3-8BFine-tuning=No2026.06 | — | — | — | — | — | — | — | — | 28.4 | 12.58 | 24.6 | 27.17 | 21.42 | 86.34 | 66.65 | |
| LLaMA-3-8BFine-tuning=Yes2026.06 | — | — | — | — | — | — | — | — | 40.8 | 21.23 | 36.57 | 34.5 | 37.02 | 89.99 | 76.41 | |
| PEGASUS-largeFine-tuning=Yes2026.06 | — | — | — | — | — | — | — | — | 46.75 | 27.13 | 40.67 | 42.61 | 40.43 | 90.35 | 76.93 | |
| T5-baseFine-tuning=Yes2026.06 | — | — | — | — | — | — | — | — | 44.25 | 25.04 | 38.92 | 38.36 | 38.09 | 89.9 | 76.06 |