Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Summarization research benchmarks – Page 18 · SOTA2 Research

Summarization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

41.77ROUGE-1

3

Feb 26, 2026

SUMMZOO few-shot

15.86MultiNews Score

3

Feb 26, 2026

18.3Attribute Score (Before)

3

Feb 26, 2026

WikiLingua High-Resource Directions

32.4RS (En->En)

3

Feb 26, 2026

WikiLingua Low-Resource Directions

26.5Fr->Th (RS) Score

3

Feb 26, 2026

WikiLingua Conventional Zero-Shot Directions

21.4RS Score (Fr->Hi)

3

Feb 26, 2026

WikiLingua Non-Trivial Zero-Shot Directions

20.2RS Score (Tr->En)

3

Feb 26, 2026

RedditTIFU long

PEGASUS-2B (calibrated)

32.03R1

3

Feb 26, 2026

MLSum fr (test)

26.09ROUGE-2

3

Feb 27, 2026

TAC 20 examples 2008 (test)

4.4Grammaticality

3

Feb 26, 2026

DUC 2007 20 examples (test)

4.7Grammaticality

3

Feb 26, 2026

TAC 2008 (test)

8.7Sr

3

Feb 26, 2026

DUC 2007 (test)

12.5Sr

3

Feb 26, 2026

AMI original (test)

82.76BERTScore

3

Feb 26, 2026

Reddit TIFU (evaluation)

30.3ROUGE-1

3

Feb 26, 2026

DailyMail non-anonymized (un-anonymized) (test)

41ROUGE-1

3

Feb 26, 2026

Summarize from Feedback

70Reward

3

Feb 26, 2026

NSF-QA Close-talk

Gemini 3.0 Flash

26.4ROUGE-L

2

Jun 17, 2026

6.309ROUGE-1

2

Jun 2, 2026

GovReport avg len ≈ 540

45.3ROUGE-L

2

Jun 1, 2026

41.8ROUGE-L

2

Jun 1, 2026

25.42R-LCS

2

May 19, 2026

Medical (OOV_RS)

23.65R-LCS

2

May 19, 2026

17.556Hyper-volume

2

Apr 7, 2026

3.9PPE

2

Mar 23, 2026

Page 18 of 19

Popular datasets

CNN/DM Xsum SamSum XLSum Pubmed

Follow for updates

Join SOTA2 Contact