Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Reading Comprehension research benchmarks – Page 8 · SOTA2 Research

Reading Comprehension

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MultiRC Dir alpha=0.1 Standard

75.21Personalized Accuracy (Acc_p)

5

Feb 26, 2026

0.623Hard Score

5

Feb 26, 2026

CosmosQA (test)

91.8Accuracy

5

Feb 26, 2026

Who Did What Relaxed (WDW-R) (test)

Gated-Attention (GA) Reader

72.6Accuracy

5

Feb 26, 2026

Who Did What (WDW) (test)

Fine-Grained Gating

71.7Accuracy

5

Feb 26, 2026

52.17Clean Accuracy

4

Jun 16, 2026

40.9Accuracy

4

Mar 18, 2026

69.98Accuracy

4

Feb 27, 2026

DROP Non-football

79.24Accuracy

4

Feb 27, 2026

Sigma-MoE-Tiny Base

0.821Accuracy (PIQA)

4

Feb 26, 2026

Federated Dataset 1 unseen tasks (test)

71.88Average Score

4

Feb 26, 2026

Translated ARC-Easy (test)

94.8Accuracy (English)

4

Feb 26, 2026

Uhura-Eval Yoruba (test)

60.5Accuracy

4

Feb 26, 2026

Uhura-Eval Hausa (test)

59.4Accuracy

4

Feb 26, 2026

Uhura-Eval Amharic (test)

44.2Accuracy

4

Feb 26, 2026

29.03BLEU

4

Feb 26, 2026

Molweni Reading Comprehension All-possible Names (test)

29.34BLEU

4

Feb 26, 2026

Molweni Reading Comprehension In-distribution Names (test)

29.31BLEU

4

Feb 26, 2026

29.44BLEU

4

Feb 26, 2026

SQuAD 2.0 (test)

29.03BLEU

4

Feb 26, 2026

Natural Questions (NQ) Long (dev)

73.2EM

4

Feb 26, 2026

Fine-tuned SOTA

90.7F1 Score

4

Feb 26, 2026

ROCStories Spring 2016 (test)

91.4Accuracy

4

Feb 26, 2026

SearchQA (test)

56.8EM

4

Feb 26, 2026

NarrativeQA Story Summaries (test)

42BLEU-1

4

Feb 26, 2026

Page 8 of 10

Popular datasets

Belebele RACE DROP BoolQ SQuAD

Follow for updates

Join SOTA2 Contact