Summarization
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
51.1ROUGE-L
5
Feb 26, 2026
0.173ROUGE-L
5
Feb 26, 2026
27.1ROUGE-L
5
Feb 26, 2026
30Book Score
5
Feb 26, 2026
7.8Mul. News Score
5
Feb 26, 2026
0.876AUC-ROC
5
Feb 26, 2026
24.86Multilingual Score
5
Feb 26, 2026
10.4ROUGE-2
5
Feb 26, 2026
4.93Fluency
5
Feb 26, 2026
55.61ROUGE-1
5
Feb 26, 2026
0.231ROUGE-1
5
Feb 26, 2026
32.9ROUGE-1
5
Feb 26, 2026
35.14ROUGE-1
5
Feb 26, 2026
47.24ROUGE-1
5
Feb 26, 2026
62.3ROUGE-1
5
Feb 26, 2026
40.4ROUGE-1
5
Feb 26, 2026
30.4ROUGE-1
5
Feb 26, 2026
72.7Correct %
5
Feb 26, 2026
41.4ROUGE-L
4
Jun 17, 2026
0Response-level Language Confusion
4
Jun 9, 2026
0Response-level Language Confusion
4
Jun 9, 2026
0Response-level Language Confusion
4
Jun 9, 2026
0Response-level Language Confusion
4
Jun 9, 2026
0Response-level Language Confusion
4
Jun 9, 2026
0Response-level Language Confusion
4
Jun 9, 2026