Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 25 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MMLU, TruthfulQA, and BBQ

69.3MMLU Accuracy

21

May 20, 2026

83.7Accuracy

21

Apr 16, 2026

42.85Factual Accuracy

21

Feb 26, 2026

28.27Factual Accuracy

21

Feb 26, 2026

49.2Factual Accuracy

21

Feb 26, 2026

47Factual Accuracy

21

Feb 26, 2026

0.434Perf

21

Feb 26, 2026

44.29F1 Score

21

Feb 27, 2026

TruthfulQA o=1 Domain-level split

W/O Decontamination

88.5Accuracy

21

Feb 26, 2026

TruthfulQA o=1 Semantic-level

W/O Decontamination

90.9Accuracy

21

Feb 26, 2026

TruthfulQA o=1 (Exact split)

W/O Decontamination

90Accuracy

21

Feb 26, 2026

TruthfulQA Domain-level split, o=3

W/O Decontamination

92.8Accuracy

21

Feb 26, 2026

TruthfulQA Semantic-level split o=3

W/O Decontamination

98.1Accuracy

21

Feb 26, 2026

TruthfulQA Exact split, o=3

W/O Decontamination

98.6Accuracy

21

Feb 26, 2026

Average (SQuAD, NewsQA, TriviaQA, NQ, HotpotQA)

0.92Faith

21

Feb 26, 2026

93.4Faithfulness

21

Feb 26, 2026

0.908Faith

21

Feb 26, 2026

87.48Faith

21

Feb 26, 2026

0.946Faithfulness

21

Feb 26, 2026

60.9Accuracy

21

Mar 18, 2026

HotpotQA December 2018 Wikipedia dump (test)

37.23EM

21

Jun 26, 2026

NQ, TriviaQA, and WebQ (test)

65.5Accuracy

21

Feb 26, 2026

ChineseSimpleQA

77.6Accuracy

21

Feb 26, 2026

89.34EM

21

Feb 26, 2026

77.6Accuracy

21

Feb 26, 2026

Page 25 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact