Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Abstractive Summarization research benchmarks – Page 4 · SOTA2 Research

Abstractive Summarization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

BillSum 24k samples (test)

57.31ROUGE-1

5

Feb 26, 2026

AESLC 18k samples (test)

37.69ROUGE-1

5

Feb 26, 2026

PubMed 133k samples (test)

45.49ROUGE-1

5

Feb 26, 2026

arXiv 215k samples (test)

44.7ROUGE-1

5

Feb 26, 2026

BIGPATENT 1341k samples (test)

53.63ROUGE-1

5

Feb 26, 2026

Reddit TIFU 42k samples (test)

26.63ROUGE-1

5

Feb 26, 2026

WikiHow 168k samples (test)

0.431ROUGE-1

5

Feb 26, 2026

Gigaword 3995k samples (test)

39.14ROUGE-1

5

Feb 26, 2026

NEWSROOM 1212k samples (test)

45.15ROUGE-1

5

Feb 26, 2026

CNN/Daily Mail full-text (test)

Ground-truth summaries

49.97NN Score (2)

5

Feb 26, 2026

16.4Perplexity

5

Feb 26, 2026

36.99ROUGE-1

5

Feb 26, 2026

Gigaword (internal test)

feats-lvt2k-2sent-ptr

36.4ROUGE-1

5

Feb 26, 2026

3.8Perplexity (Generated)

4

Jun 2, 2026

arXiv 100 samples

21.9SDE

4

Jun 2, 2026

PubMed 100 samples

0SDE

4

Jun 2, 2026

CNN/DM 100 samples

20.2SDE

4

Jun 2, 2026

XSum 100 samples

37SDE

4

Jun 2, 2026

TVSTORYSUM TVMegaSite (test)

Extractive oracle

16.9BLEU

4

Feb 26, 2026

TVSTORYSUM Fandom (test)

Extractive oracle

8.3BLEU

4

Feb 26, 2026

0.64Rank 1

4

Feb 26, 2026

SciTLDR AIC (test)

32.1Mean ROUGE-1

4

Feb 26, 2026

28.2ROUGE-1

3

May 4, 2026

Arxiv Abstract Dataset 16K sequence length (test)

43.6ROUGE-1

3

Feb 26, 2026

Arxiv Abstract Dataset 12K sequence length (test)

45.4R1 Score

3

Feb 26, 2026

Page 4 of 5

Popular datasets

Xsum Gigaword CNN Dailymail ArXiv SamSum

Follow for updates

Join SOTA2 Contact