Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Summarization Evaluation research benchmarks · SOTA2 Research

Summarization Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0.902Avg Spearman Rho

55

Jun 26, 2026

57Coherence

41

Feb 26, 2026

0.546Pearson Correlation

40

Apr 7, 2026

SummEval 1.0 (test)

0.594Coherence (Spearman rho)

21

Feb 26, 2026

MILE-RefHumEval

0.495MSE

8

Feb 26, 2026

SummEval Relevance Domain

0.96Corr.

8

Feb 26, 2026

1.55Relevance (theta_ratio)

7

Feb 26, 2026

0.833Spearman Correlation

6

Mar 11, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact