Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 31 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

∞-Bench Longbook QA English (test)

11.2F1 Score

18

May 27, 2026

37.74EM

18

Feb 26, 2026

Natural Questions

LLM (with RAG*)

45.72EM

18

Feb 26, 2026

37.9Mean@16

18

Feb 26, 2026

76.42Average Score

18

Feb 26, 2026

Combined 7 Datasets

45Average Score

18

Feb 26, 2026

HotpotQA (test)

68EM

18

Feb 26, 2026

SimpleQA-verified OOD

Vanilla Search-R1

42.2Accuracy

18

Feb 26, 2026

56.8Accuracy

18

Feb 26, 2026

69.3Accuracy

18

Feb 26, 2026

60Cover EM

18

Feb 26, 2026

0.574Cover EM

18

Feb 26, 2026

62.4Cover Exact Match

18

Feb 26, 2026

24.3Cover EM

18

Feb 26, 2026

52.4Cover EM

18

Feb 26, 2026

79.82EM

18

Feb 26, 2026

Average 100K context

67.1Accuracy

18

Feb 27, 2026

Average 30K context

69.8Accuracy

18

Feb 27, 2026

TriviaQA 100K context

70.2Accuracy

18

Feb 27, 2026

TriviaQA 30K context

0.813Accuracy

18

Feb 27, 2026

NQ 100K context

0.583Accuracy

18

Feb 27, 2026

51.1Accuracy

18

Feb 27, 2026

HotpotQA 100K context

79.4Accuracy

18

Feb 27, 2026

HotpotQA 30K context

78.9Accuracy

18

Feb 27, 2026

34.79EM

18

Feb 26, 2026

Page 31 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact