Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Open-domain Question Answering research benchmarks – Page 6 · SOTA2 Research

Open-domain Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MKQA Target Language (test)

40.64NOB Accuracy

5

Feb 26, 2026

26.5EM

5

May 25, 2026

3.8Joint Answer-and-Evidence Score

4

May 25, 2026

7Joint Answer-Evidence Score

4

May 25, 2026

15.2Joint Answer-Evidence Score

4

May 25, 2026

26.4Joint Answer-and-Evidence Score

4

May 25, 2026

34.2Joint Answer-Evidence Score

4

May 25, 2026

24.75R@1

4

Apr 23, 2026

37.39R@1

4

Apr 23, 2026

29.23R@1

4

Apr 23, 2026

MuSiQue 500 randomly chosen questions

17.6EM

4

Feb 26, 2026

MuSiQue (500 randomly chosen questions)

1BM25 Queries

4

Feb 26, 2026

2WikiMultiHopQA (500 randomly chosen questions)

3.47BM25 Queries

4

Feb 26, 2026

HotpotQA (500 randomly chosen questions)

1BM25 Queries

4

Feb 26, 2026

37.22STR-EM

4

Feb 26, 2026

KILT TriviaQA (test)

74.5Retrieval

4

Feb 26, 2026

KILT NQ* (test)

65.1Retrieval Rate

4

Feb 26, 2026

EntityQuestion (EQ) (dev)

66Accuracy

4

Feb 26, 2026

TriviaQA Entity Subset (TQAe) (dev)

64.8Accuracy

4

Feb 26, 2026

CuratedTREC (CT) standard (test)

52.2Exact Match

4

Feb 26, 2026

TriviaQA Open (dev)

Discrete Hard EM

50.7Exact Match

4

Feb 26, 2026

MuSiQue Search-o1 framework (test)

20.4Accuracy

3

May 12, 2026

Bamboogle Search-o1 framework (test)

34.9Accuracy

3

May 12, 2026

2WikiMultihopQA Search-o1 framework (50% held-out test)

39.2Accuracy

3

May 12, 2026

HotpotQA Search-o1 framework (test)

28.8Accuracy

3

May 12, 2026

Page 6 of 7

Popular datasets

TriviaQA Natural Questions HotpotQA MuSiQue NQ

Follow for updates

Join SOTA2 Contact