Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 36 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

28.94F1 Score

16

Feb 26, 2026

0.368F1 Score

16

Feb 26, 2026

CLEAR Real-world 1.0

94.7Acc

16

Feb 26, 2026

CLEAR 1.0 (Retain)

0.352R-L Score

16

Feb 26, 2026

CLEAR Forget 1.0

0.367R-L Score

16

Feb 26, 2026

MLLMU-Bench Real-world 1.0

78.3Accuracy

16

Feb 26, 2026

MLLMU-Bench 1.0 (Retain)

58.6Accuracy

16

Feb 26, 2026

MLLMU-Bench Forget 1.0

55Accuracy

16

Feb 26, 2026

50-question climate adaptation dataset 1.0 (test)

3Context Quality Score

16

Feb 26, 2026

XTREME QA Average across all orders (test)

59.41EM

16

Feb 26, 2026

XTREME QA Order 6 - Long Sequence (test)

0.609EM

16

Feb 26, 2026

XTREME QA Order 5 - Long Sequence (test)

60.92EM

16

Feb 26, 2026

XTREME QA Order 4 - Long Sequence (test)

60.84EM

16

Feb 26, 2026

XTREME QA Order 3 - Short Sequence (test)

58EM

16

Feb 26, 2026

XTREME QA Order 2 - Short Sequence (test)

57.99EM

16

Feb 26, 2026

XTREME QA Order 1 - Short Sequence (test)

57.85EM

16

Feb 26, 2026

Humanity's Last Exam

Yunque DeepResearch

51.7Pass@1

16

Feb 26, 2026

Average (PopQA, HotpotQA, 2Wiki, MuSiQue, Bamboogle)

42.54EM

16

Jul 9, 2026

PopQA v1.0 (test)

83.07A1

16

Feb 26, 2026

TriviaQA v1.0 (test)

0.688A1 Accuracy

16

Feb 26, 2026

NQ-open v1.0 (test)

79.08A1

16

Feb 26, 2026

BBQ (Bias Benchmark for QA) v1.0 (test)

93.1BBQ SES Score

16

Feb 26, 2026

15Accuracy

16

Feb 26, 2026

26.8Accuracy

16

Mar 17, 2026

TriviaQA (TQA) (test)

79.8Exact Match

16

Feb 26, 2026

Page 36 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact