Summarization
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
13.97ROUGE-2
11
Feb 26, 2026
44.54ROUGE-1
11
Feb 26, 2026
50.26ROUGE-1
11
Feb 26, 2026
40.8ROUGE-1
11
Feb 26, 2026
83.4Win Rate (0% Flip Rate)
10
Jul 7, 2026
73.44Correlation Score (Corr)
10
May 27, 2026
156.35Decoding Speed (tokens/s)
10
May 4, 2026
50.78ROUGE-1
10
Apr 21, 2026
59.5ROUGE Score (R)
10
Mar 23, 2026
13.8ROUGE-2
10
Feb 27, 2026
0.258Mean Total Edit Distance
10
Feb 26, 2026
0.185Mean Total Edit Distance
10
Feb 26, 2026
24.6ROUGE Score
10
Feb 26, 2026
4.4Coherence
10
Feb 26, 2026
0.86BERTScore
10
Feb 26, 2026
32.17Main Score
10
Feb 26, 2026
0.857BERTScore
10
Feb 26, 2026
83.8BERTScore
10
Feb 26, 2026
0.757BERTScore
10
Feb 26, 2026
0.783BERTScore
10
Feb 26, 2026
0.769BERTScore
10
Feb 26, 2026
34.04BLEU
10
Feb 26, 2026
23.28BLEU
10
Feb 26, 2026
33.12RL Score
10
Feb 26, 2026
35.99RL Score
10
Feb 26, 2026