Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Open-domain QA research benchmarks · SOTA2 Research

Open-domain QA

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Bambogle v1 (out-of-domain)

64.7F1 Score

33

Apr 27, 2026

Overall QA Suite (NQ, TriviaQA, PopQA, HotpotQA, 2WikiMultiHopQA, MuSiQue, Bamboogle)

62.3Average EM

30

May 13, 2026

74.4EM

20

Mar 19, 2026

37.6QA-F1

16

Feb 26, 2026

47QA-F1

16

Feb 26, 2026

41.8QA-F1

16

Feb 26, 2026

48.1QA-F1

16

Feb 26, 2026

HotpotQA (HQA) (test)

0.311Exact Match

10

Feb 26, 2026

TriviaQA (TQA) (test)

64.5EM

10

Feb 26, 2026

HotPotQA top 1000 samples (test)

38.6F1

10

Feb 26, 2026

TriviaQA (TQA) top 1000 samples (test)

52.3EM

10

Feb 26, 2026

NaturalQuestions (NQ) top 1000 samples (test)

40.3Exact Match

10

Feb 26, 2026

78.2Accuracy

8

Feb 26, 2026

20.75R-L

8

Feb 26, 2026

72.94EM

8

Feb 26, 2026

SituatedQA Nq=300

44.6Accuracy

6

Feb 26, 2026

0.473Acc

6

Feb 26, 2026

Federated Dataset 1 unseen tasks (test)

78.76AVG Score

4

Feb 26, 2026

Popular datasets

TriviaQA HotpotQA ELI5 NQ Trec

Follow for updates

Join SOTA2 Contact