Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Abstractive Summarization research benchmarks – Page 2 · SOTA2 Research

Abstractive Summarization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

17.9XSum Score

14

Feb 26, 2026

Spotify Podcast 2020 (test)

27.81ROUGE-1

13

Feb 26, 2026

Average across 8 datasets

Self-Consistency (SC)

19.89ROUGE Score

12

Feb 26, 2026

SciGen sampled (test)

Iterative Refine (IR)

18.42ROUGE Score

12

Feb 26, 2026

BookSum sampled (test)

Iterative Refine (IR)

17.71ROUGE Score

12

Feb 26, 2026

ArXiv sampled (test)

Iterative Refine (IR)

23.65ROUGE

12

Feb 26, 2026

WikiHow sampled (test)

Cited Summarization (Cite)

17.58ROUGE

12

Feb 26, 2026

Reddit sampled (test)

Self-Consistency (SC)

14.82ROUGE Score

12

Feb 26, 2026

SAMSum sampled (test)

26.88ROUGE Score

12

Feb 26, 2026

CNN/DM sampled (test)

Extract-to-Abstract (E2A)

22.86ROUGE Score

12

Feb 26, 2026

Multi-News 56k samples (test)

Question-Answer Guided (QAG)

20.72ROUGE Score

12

Feb 26, 2026

31.9ROUGE-1

12

Feb 26, 2026

Gigaword full-length F1 (test)

37.04ROUGE-1 F1

12

Feb 26, 2026

6.75BLEU

11

Feb 26, 2026

11.9BLEU Score

11

Feb 26, 2026

0.12BLEU

11

Feb 26, 2026

48.31ROUGE-1 (R-1)

11

Feb 26, 2026

47.78ROUGE-1

11

Feb 26, 2026

Stack ConvoSumm 1.0 (test)

39.73ROUGE-1

11

Feb 26, 2026

CNN/Daily Mail anonymized (test)

41.69ROUGE-1

11

Feb 26, 2026

18.87ROUGE-L

10

May 26, 2026

Mistral-7B-Instruct

13ROUGE

10

Apr 8, 2026

New York Times F1 variants of Rouge (test)

DCA MLE+SEM+RL, mpgen, with-comm, with caa (m7)

48.08ROUGE-1

10

Feb 26, 2026

86BERTScore

8

Jun 16, 2026

YouCook2 (test)

33ROUGE-1

8

May 13, 2026

Page 2 of 5

Popular datasets

Xsum Gigaword CNN Dailymail ArXiv SamSum

Follow for updates

Join SOTA2 Contact