Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Abstractive Summarization research benchmarks – Page 3 · SOTA2 Research

Abstractive Summarization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

44.9ROUGE-1

8

Mar 13, 2026

SciTLDR Abstracts

43.8ROUGE-1

8

Mar 13, 2026

OrangeSum (test)

100ROUGE-L

8

Mar 10, 2026

53.8ROUGE-1

8

Feb 26, 2026

Gigaword non-anonymized (test)

38.45ROUGE-1

7

Feb 27, 2026

44.41ROUGE-1

7

Feb 26, 2026

ERNIE-GEN_LARGE

39.25ROUGE-1

7

Feb 26, 2026

39.4ROUGE-1

7

Feb 26, 2026

45.19ROUGE-L

6

Jun 4, 2026

8.79ROUGE-2

6

Apr 10, 2026

SciTLDR Full Text

36.92ROUGE-1

6

Mar 13, 2026

59.67ROUGE-1

6

May 26, 2026

Gigaword 10k samples

35.51ROUGE-1

6

Feb 26, 2026

CNN/Daily Mail (test)

39ROUGE-1

5

May 29, 2026

40.2ROUGE-1

5

May 29, 2026

Reddit, Stack, and Bitcoin Human Evaluation

4.9Coverage

5

Apr 21, 2026

69.45Overall Score

5

Feb 26, 2026

3.4Baseline Throughput (samples/s)

5

Feb 26, 2026

WikiCatSum Animal (test)

3.56Completeness

5

Feb 26, 2026

WikiCatSum Film (test)

3.2Completeness

5

Feb 26, 2026

WikiCatSum Company (test)

2.96Completeness

5

Feb 26, 2026

ConvoSumm Email 1.0 (test)

41.46ROUGE-1

5

Feb 26, 2026

Reddit ConvoSumm 1.0 (test)

BART-arg-filtered

36.51ROUGE-1

5

Feb 26, 2026

NYT ConvoSumm 1.0 (test)

BART-arg-filtered

36.6ROUGE-1

5

Feb 26, 2026

OrangeSum Abstract (test)

27.38Human Score (BWS)

5

Feb 26, 2026

Page 3 of 5

Popular datasets

Xsum Gigaword CNN Dailymail ArXiv SamSum

Follow for updates

Join SOTA2 Contact