Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 48 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MRQA Out-of-domain

47.72F1 Score

12

Mar 12, 2026

63.63F1 Score

12

Mar 12, 2026

Search-augmented QA tasks Average

48.3Average Accuracy

12

Mar 11, 2026

StackExchange (test)

65.6Accuracy

12

Mar 10, 2026

59.6Accuracy

12

Mar 10, 2026

OpenBookQA D^v (train)

100Accuracy

12

Feb 27, 2026

71.4Accuracy

12

Feb 27, 2026

HotpotQA D (eval)

46.2Accuracy

12

Feb 27, 2026

HotpotQA D (train)

95.4Accuracy

12

Feb 27, 2026

HotpotQA (train)

100Accuracy

12

Feb 27, 2026

88Open Accuracy

12

Feb 26, 2026

90.1Accuracy

12

Apr 28, 2026

93Pass@1

12

Feb 26, 2026

TriviaQA (test)

0.923F1 Score

12

Feb 26, 2026

OpenBook QA (test)

28.8Accuracy

12

Feb 26, 2026

NaturalQuestions Open

7.7Exact Match

12

Feb 26, 2026

LongBench HotpotQA

63.58F1 Score

12

May 29, 2026

0.824Acc

12

Feb 26, 2026

91.4Accuracy

12

Feb 26, 2026

OpenAI (in-domain)

calibration-aware reinforcement learning

0.896Accuracy

12

Feb 26, 2026

OBQA (out-of-domain)

calibration-aware reinforcement learning

95.59Acc

12

Feb 26, 2026

83.93Disambiguation TOP-1

12

Feb 26, 2026

60.94EM (LQ)

12

Feb 26, 2026

45.36EM (Long Question)

12

Feb 26, 2026

NQ in-corpus setting (test)

39Accuracy

12

Feb 26, 2026

Page 48 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact