Summary Quality Ranking on FeedSum (test)
0.22Median Spearman CorrelationQwen*
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen*Fine-tuned=true2026.04 | 0.22 | -0.02 | — | — | — | — | |
| LLaMA*Fine-tuned=true2026.04 | 0.15 | -0.19 | — | — | — | — | |
| Mistral*Fine-tuned=true2026.04 | 0.09 | -0.19 | — | — | — | — | |
| SummLLaMAFine-tuned=false2026.04 | 0.04 | -0.26 | — | — | — | — | |
| LLaMAFine-tuned=false2026.04 | 0 | -0.3 | — | — | — | — | |
| QwenFine-tuned=false2026.04 | -0.02 | -0.34 | — | — | — | — | |
| MistralFine-tuned=false2026.04 | -0.03 | -0.23 | — | — | — | — | |
| LLaMAFine-tuned=false2026.04 | — | — | 0.034 | -0.244 | 0.013 | -0.244 | |
| LLaMA*Fine-tuned=true2026.04 | — | — | 0.195 | -0.146 | 0.114 | -0.164 | |
| MistralFine-tuned=false2026.04 | — | — | 0.003 | -0.24 | -0.018 | -0.177 | |
| Mistral*Fine-tuned=true2026.04 | — | — | 0.109 | -0.211 | 0.066 | -0.148 | |
| QwenFine-tuned=false2026.04 | — | — | 0.027 | -0.299 | -0.034 | -0.262 | |
| Qwen*Fine-tuned=true2026.04 | — | — | 0.236 | -0.021 | 0.175 | -0.024 | |
| SummLLaMAFine-tuned=false2026.04 | — | — | -0.037 | -0.346 | 0.035 | -0.182 |