Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 54 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

HotpotQA (test)

0Cost (cents)

11

Mar 24, 2026

0Cost (cents)

11

Mar 24, 2026

73.9Accuracy

11

Mar 4, 2026

G-bench Medical

73.3Accuracy

11

Mar 4, 2026

76.52QA Accuracy

11

Mar 4, 2026

TriviaQA Single-Answer

1.89ECE

11

Mar 4, 2026

ALIGNX Reddit QA(RQ) (val)

18.9ROUGE-1

11

Feb 27, 2026

WebQuestions (test)

Ensemble with (Berant & Liang, 14)

41.8F1 (Berant)

11

Feb 27, 2026

Standard QA Benchmarks (2WikiMultiHopQA, HotpotQA, Bamboogle, MuSiQue, Natural Questions, TriviaQA, PopQA) (test)

80.42WikiMultiHopQA Pass@1

11

Feb 26, 2026

28.92Accuracy (Normalized)

11

Feb 26, 2026

ARC Bengali (test)

Trinity Large (MoE)

79ARC Accuracy

11

Feb 26, 2026

ARC Spanish (test)

0.92Accuracy

11

Feb 26, 2026

MiniCPM-V-2.6 8B

63Accuracy

11

Feb 26, 2026

77.31Accuracy (Baseline)

11

Feb 26, 2026

77.3TriviaQA Score

11

Feb 26, 2026

FRAMES out-domain (test)

31.31LasJ

11

Feb 26, 2026

MuSiQue in-domain (test)

33.47LasJ

11

Feb 26, 2026

2WikiMultiHopQA out-domain (test)

56.32LasJ

11

Feb 26, 2026

HotpotQA in-domain (test)

61.59LASJ

11

Feb 26, 2026

SimpleQA out-domain (test)

36.5LasJ

11

Apr 7, 2026

61.3EM

11

Feb 26, 2026

Israeli Trivia 300 questions

DictaLM-3.0-24B-Thinking

60.13Accuracy

11

Feb 27, 2026

ComplexWebQuestions (CWQ)

38.41Total F1

11

Feb 26, 2026

76.56Normalized sub-EM Accuracy

11

Feb 26, 2026

LycheeMemory-7B w/o Gate

75Normalized Sub-EM Accuracy

11

Feb 26, 2026

Page 54 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact