Text Summarization on FeedSum (test)
3.53ConsistencySummLLaMA
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SummLLaMACategory=Com↑2026.04 | 3.53 | 2.02 | 0.72 | 3 | 23 | 8 | 4 | 31 | |
| LLaMACategory=Com↑2026.04 | 3.5 | 2.11 | 0.84 | 3.06 | 23 | 8 | 4 | 30 | |
| LLaMA*Category=Com↑2026.04 | 3.48 | 2.08 | 0.85 | 3.19 | 23 | 8 | 4 | 31 | |
| LLaMA*Category=Bal2026.04 | 3.38 | 1.88 | 0.65 | 2.92 | 27 | 10 | 4 | 30 | |
| SummLLaMACategory=Bal2026.04 | 3.34 | 1.67 | 0.45 | 2.58 | 27 | 10 | 4 | 29 | |
| LLaMACategory=Bal2026.04 | 3.29 | 1.91 | 0.63 | 2.76 | 27 | 9 | 4 | 30 | |
| LLaMA*Category=Con↑2026.04 | 2.89 | 1.63 | 0.49 | 2.61 | 28 | 9 | 4 | 28 | |
| LLaMACategory=Con↑2026.04 | 2.87 | 1.58 | 0.44 | 2.49 | 28 | 9 | 4 | 29 | |
| SummLLaMACategory=Con↑2026.04 | 2.48 | 1.3 | 0.33 | 2.22 | 28 | 9 | 4 | 27 |