Summarization Evaluation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
0.902Avg Spearman Rho
55
Jun 26, 2026
57Coherence
41
Feb 26, 2026
0.546Pearson Correlation
40
Apr 7, 2026
0.594Coherence (Spearman rho)
21
Feb 26, 2026
0.495MSE
8
Feb 26, 2026
0.96Corr.
8
Feb 26, 2026
1.55Relevance (theta_ratio)
7
Feb 26, 2026
0.833Spearman Correlation
6
Mar 11, 2026