Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 22 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Average (TriviaQA, HotpotQA, 2Wiki, Musique, Bamboogle)

49.12EM Accuracy

24

Mar 10, 2026

42.9Exact Match Accuracy (EM)

24

Mar 10, 2026

75.4EM Accuracy

24

Mar 10, 2026

63.2Accuracy

24

Jun 5, 2026

Mistral Small 24B Inst 2501

91.6Accuracy

24

Feb 26, 2026

57.9EM

24

Jun 9, 2026

88.59Accuracy

24

Feb 26, 2026

WIKI-BALANCE (test)

66Avg. PS Shift (%)

24

Feb 26, 2026

31.03Accuracy

24

Feb 26, 2026

Merged QA HotpotQA, NarrativeQA, WikiHop (test)

63.34Accuracy

24

Feb 26, 2026

HotpotQA (test)

90.2Accuracy

24

Feb 26, 2026

84.45Accuracy

24

Feb 26, 2026

61.8Accuracy

24

Feb 26, 2026

85.79Accuracy

24

Feb 26, 2026

FriendsQA (test)

Enhanced Speaker-aware Model

58.7EM

24

Feb 26, 2026

TrecQA clean (test)

87.7MRR

24

Feb 26, 2026

78.6Accuracy

24

Feb 26, 2026

49.8Accuracy

24

Feb 26, 2026

SQuAD entity-level knowledge conflict (test)

9.7MR

24

Feb 26, 2026

MuSiQue entity-level knowledge conflict (test)

7.7Mean Rank

24

Feb 26, 2026

63.1Accuracy

23

Jul 9, 2026

79.66Accuracy (WebQ)

23

Jul 9, 2026

Qwen3-8B + SFT + WeMask(TF)

87.6Accuracy

23

May 14, 2026

HotpotQA In-Distribution

93.95F1 Score

23

May 15, 2026

78.38Accuracy

23

Jul 1, 2026

Page 22 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact