Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 61 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

70.81EM

10

Feb 26, 2026

NewsQA trained on CausalQA OOD (test)

9.54F1 Score

10

Feb 26, 2026

SQuAD trained on CausalQA OOD (test)

27.61F1

10

Feb 26, 2026

CausalQA trained on NewsQA OOD (test)

51.64F1

10

Feb 26, 2026

CausalQA trained on SQuAD OOD (test)

66.86F1 Score

10

Feb 26, 2026

AdversarialQA dRoberta

28.05Accuracy

10

Feb 26, 2026

84.1EM

10

Feb 27, 2026

MULTIHIERTT (dev)

37.05EM

10

Feb 26, 2026

0.612Execution Accuracy

10

Feb 27, 2026

90.9Accuracy

10

Jul 8, 2026

80F1 Score

10

Feb 26, 2026

72BLEU-1

10

Feb 26, 2026

0.891Score

10

Mar 10, 2026

Adversarial SQuAD AddOneSent

ALUM-RoBERTa-Large

81.4EM

10

Feb 26, 2026

bAbI 10k 1.0 (test)

Universal Transformer with dynamic halting

21Mean Error Rate

10

Feb 26, 2026

SQuAD 2.0 extracted on Sep 9, 2018 (dev)

86.3EM

10

Feb 27, 2026

bAbI 1.0 (test)

0.4Task 1 Accuracy

10

Feb 26, 2026

OOD Average GPQA & MMLU-Pro

83.3Accuracy

9

Jun 30, 2026

62.93Exact Match (EM)

9

Jun 19, 2026

77.03Exact Match (EM)

9

Jun 19, 2026

Original (target)

66.38ARC-C Utility

9

Jun 16, 2026

64Accuracy (Clean)

9

Jun 16, 2026

54.52Accuracy (Clean)

9

Jun 16, 2026

Composite-9 n=50

0.01Latency p50 (s)

9

Jun 11, 2026

8.81Quality Score

9

Jun 4, 2026

Page 61 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact