Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 43 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

43.92Vanilla Accuracy

14

Feb 26, 2026

Bamboogle 500 samples (val)

34.6EM

14

Feb 26, 2026

2Wiki 500 samples (val)

39.6EM

14

Feb 26, 2026

HotpotQA 500 samples (val)

34.4EM

14

Feb 26, 2026

Qwen 3 VL 8B Inst

51.1Score

14

Feb 26, 2026

66.8Accuracy

14

Feb 26, 2026

MS MARCO randomly selected 150 data points

100BAR

14

Feb 26, 2026

Average (NQ, TriviaQA, HotpotQA, StrategyQA, 2WikiMHQA)

55Average Score

14

Feb 26, 2026

OpenBookQA Official Leaderboard

95.2Accuracy

14

Feb 26, 2026

54.9EM

14

Feb 26, 2026

AdversarialQA dBERT

39.51Accuracy

14

Feb 26, 2026

QA Tasks (unseen)

42.12AN' Score

14

Feb 26, 2026

QA Tasks seen (test)

59.23AN

14

Feb 26, 2026

PubMedQA (out-of-domain)

11.7ROUGE-L

14

Feb 26, 2026

PIQA out-of-domain

19.1ROUGE-L

14

Feb 26, 2026

MSMARCO Wiki-answerable

57.2ROUGE-L

14

Feb 26, 2026

ELI5 Wiki-answerable

26.6ROUGE-L Score

14

Feb 26, 2026

99.6WebQ Accuracy

14

May 28, 2026

87.82F1 Score

14

Feb 26, 2026

8 Question Answering Benchmarks (OBQA, PIQA, ARC-E, ARC-C, HellaSwag, SciQ, WebQs, RACE) (test)

38.8OBQA

14

Feb 26, 2026

WikiMovies (test)

Key-Value Memory Network

93.9Hits@1

14

Feb 26, 2026

89.23OpenbookQA Score

13

Jul 3, 2026

2WikiMultiHopQA

46.2Accuracy

13

Jun 29, 2026

64.5Accuracy

13

Jun 19, 2026

MMLU-PRO (test)

56.37Pass@1 Accuracy

13

Jun 9, 2026

Page 43 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact