Document Ranking on RoSE (test)
0.431Kendall TauROUGE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ROUGEInput Source=Document + System summary2025.04 | 0.431 | 0.652 | 0.597 | |
| PreSummRegInput Source=Document only2025.04 | 0.321 | 0.463 | 0.46 | |
| PreSummClasInput Source=Document only2025.04 | 0.306 | 0.389 | 0.389 | |
| PreSummRegFrozInput Source=Document only2025.04 | 0.279 | 0.406 | 0.403 | |
| BERTScoreInput Source=Document + System summary2025.04 | 0.252 | 0.43 | 0.351 | |
| BlancInput Source=Document + System summary2025.04 | 0.246 | 0.322 | 0.347 | |
| SummaQAInput Source=Document + System summary2025.04 | 0.167 | 0.241 | 0.286 | |
| Document lengthInput Source=Document only2025.04 | -0.005 | -0.048 | -0.01 | |
| Count of NumbersInput Source=Document only2025.04 | -0.016 | -0.106 | -0.023 | |
| Flesch Reading EaseInput Source=Document only2025.04 | -0.016 | 0.03 | -0.021 | |
| Flesch Kincaid GradeInput Source=Document only2025.04 | -0.0489 | -0.0483 | -0.0104 | |
| # Unique Named EntitiesInput Source=Document only2025.04 | -0.054 | -0.134 | -0.071 |