Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Summarization research benchmarks – Page 19 · SOTA2 Research

Summarization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

ZeroSCROLLS SpaceDigest (test)

77.9ES

2

Mar 18, 2026

Exp-k=2 (7.5, 0)

25.3Accuracy

2

Feb 26, 2026

LongBench VCSUM

Qwen1.5 1.8B (ARL)

9.04VCSUM Score

2

Feb 26, 2026

LongBench MultiNews

Qwen1.5 1.8B (ARL)

14.91Score

2

Feb 26, 2026

LongBench QMSum

Qwen1.5 1.8B (ARL)

15.91Score

2

Feb 26, 2026

LongBench GovReport

Qwen1.5 1.8B (ARL)

18.2Score

2

Feb 26, 2026

Japanese Summarization JA (test)

Vanilla Decoding

10.4ROUGE-2

2

Feb 26, 2026

Korean Summarization (Ko) (test)

Vanilla Decoding

14.7ROUGE-2

2

Feb 26, 2026

Japanese Summarization (test)

13.2ROUGE-2

2

Feb 26, 2026

Korean Summarization (test)

Vanilla Decoding

23ROUGE-2

2

Feb 26, 2026

XSum 100 sample subset (test)

6Informativeness (Pairwise Lose)

2

Feb 26, 2026

MLSum de (test)

0.342ROUGE-L

2

Feb 27, 2026

46.1R-1 Score

2

Feb 26, 2026

Multi-XScience (test)

Lu et al. (2020)

33.9ROUGE-1

2

Feb 26, 2026

Preference Optimization Summarization

0.3Reward

2

Feb 26, 2026

Thoughts-as-Planning

21.8Performance Score

1

May 29, 2026

GEM XSum en (test)

—

—ROUGE-2

0

Feb 26, 2026

WikiLingua vi -> en GEM (test)

—

—ROUGE-2

0

Feb 26, 2026

WikiLingua ru -> en GEM (test)

—

—ROUGE-2

0

Feb 26, 2026

MLSum es (test)

—

—ROUGE-2

0

Feb 26, 2026

Page 19 of 19

Popular datasets

CNN/DM Xsum SamSum XLSum Pubmed

Follow for updates

Join SOTA2 Contact