Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 112 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Urdu Question Answering

80.4Score

3

Feb 26, 2026

Turkish QA 2 datasets average

68.5QA Score

3

Feb 26, 2026

Self-Improving Pretraining

27.7MC1

3

Feb 26, 2026

Transport and Merge

24Accuracy

3

Feb 26, 2026

78.64Accuracy

3

Feb 26, 2026

60.42Accuracy

3

Feb 26, 2026

40.2Context Relevance Score

3

Feb 26, 2026

74.3Context Relevance

3

Feb 26, 2026

87.5EM

3

Feb 26, 2026

17.19EM

3

Feb 26, 2026

Theorem QA v1 (test)

25.3Accuracy

3

Feb 26, 2026

34.3Accuracy

3

Feb 26, 2026

Google-proof QA (test)

55Accuracy

3

Feb 26, 2026

bAbI 10K synthesized samples

26.8Accuracy

3

Feb 26, 2026

Natural Questions (NQ)

52.72AUC Top-1 Acc

3

Feb 26, 2026

50.4Accuracy

3

Feb 26, 2026

Question Answering (test)

4.25Relative CPU Speed

3

Feb 26, 2026

EntailmentBankQA Challenge (test)

59.1Answer Accuracy

3

Feb 26, 2026

EntailmentBankQA Easy (test)

70.8Answer Accuracy

3

Feb 26, 2026

EntailmentBankQA All (test)

67.1Accuracy

3

Feb 26, 2026

XQuAD languages not in MLQA

XLM-R Base MS, LT-SFT

81.9F1 (el)

3

Feb 26, 2026

12.94Throughput (TPS)

3

Apr 21, 2026

Natural Questions (NQ) single-answer (test)

recall-then-verify

54.8Exact Match

3

Feb 26, 2026

Natural Questions (NQ) single-answer (dev)

recall-then-verify

52.8Exact Match

3

Feb 26, 2026

0.908Accuracy

3

Feb 26, 2026

Page 112 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact