Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Open-domain Question Answering research benchmarks – Page 5 · SOTA2 Research

Open-domain Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Natural Questions (scarce)

35.9EM & F1 Score

6

Feb 26, 2026

TriviaQA abundant

73.4F1 Score

6

Feb 26, 2026

TriviaQA (medium)

71EM & F1 Score

6

Feb 26, 2026

TriviaQA (scarce)

68.3F1 Score

6

Feb 26, 2026

HotpotQA (abundant)

45.7F1 Score

6

Feb 26, 2026

HotpotQA (medium)

43.9F1 Score

6

Feb 26, 2026

HotpotQA (scarce)

41.9EM & F1 Score

6

Feb 26, 2026

Curated TREC (medium)

40.6EM/F1 Score

6

Feb 26, 2026

Curated TREC (scarce)

37.8EM & F1

6

Feb 26, 2026

Web Questions (abundant)

46.4EM/F1 Score

6

Feb 26, 2026

Web Questions medium

42.1F1 Score

6

Feb 26, 2026

Web Questions (scarce)

38.5Exact Match / F1

6

Feb 26, 2026

TriviaQA (TQA) few-shot Filtered (test)

Codex + REPLUG LSR

77.3Exact Match (EM)

6

Feb 26, 2026

ComplexWebQuestions (CWQ) (dev)

47.7Accuracy

6

Feb 26, 2026

33Rouge-L

5

May 28, 2026

TriviaQA 11.3K (test)

40.2EM

5

Feb 26, 2026

0.261EM

5

Feb 26, 2026

Curated TREC (abundant)

36.9F1 Score

5

Feb 26, 2026

52.51Trivia QA Score

5

Feb 26, 2026

HotpotQA distractor (val)

Closed-Book QA w. Mixed Training + Recitation

21EM

5

Feb 26, 2026

Natural Questions (NQ) Karpukhin et al. (val)

Closed-Book QA w. Mixed Training + Recitation

16.1EM

5

Feb 26, 2026

Llama-2 (7B) + Attention Buckets

53.1Accuracy

5

Feb 26, 2026

COMPMIX first 100 samples (dev)

92Platinum Score

5

Feb 26, 2026

58.5Exact Match

5

Feb 26, 2026

MKQA English Language (test)

45.42NOB Accuracy

5

Feb 26, 2026

Page 5 of 7

Popular datasets

TriviaQA Natural Questions HotpotQA MuSiQue NQ

Follow for updates

Join SOTA2 Contact