Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Open-domain Question Answering research benchmarks – Page 7 · SOTA2 Research

Open-domain Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

TriviaQA Search-o1 framework (50% held-out test)

69.6Accuracy

3

May 12, 2026

NQ Search-o1 framework (50% held-out test)

44.8Accuracy

3

May 12, 2026

35.28BLEU-1

3

Apr 23, 2026

75.23Exact Match (EM)

3

Apr 23, 2026

MuSiQue 1,000 samples

38.5EM

3

Feb 26, 2026

HotpotQA 1,000 samples

0.626EM

3

Feb 26, 2026

Natural Questions (NQ) full train (test)

60.4EM

3

Feb 26, 2026

TriviaQA Open-Domain wiki (dev)

75.8Accuracy

3

Feb 26, 2026

OpenDRCD (test)

74.6F1

3

Feb 26, 2026

OpenCMRC (test)

79.9F1 Score

3

Feb 26, 2026

77LAMA Score

2

Jun 29, 2026

58.47Output Token Throughput (tok/s)

2

Feb 26, 2026

Natural Questions

26.6Exact Match

2

Feb 26, 2026

MuSiQue 2-hop questions

34.2EM

2

Feb 26, 2026

HotpotQA Bridge questions (test val)

50EM

2

Feb 26, 2026

MuSiQue 2-hop (test)

34.2EM

2

Feb 26, 2026

HotpotQA Bridge (test)

58.5F1

2

Feb 26, 2026

Knowledge-intensive tasks

—

—Primary metric

0

Apr 7, 2026

2WIKI multi-hop (test)

—

—Accuracy

0

Feb 26, 2026

PopQA single-hop (test)

—

—Accuracy

0

Feb 26, 2026

TriviaQA single-hop (test)

—

—Acc

0

Feb 26, 2026

Page 7 of 7

Popular datasets

TriviaQA Natural Questions HotpotQA MuSiQue NQ

Follow for updates

Join SOTA2 Contact