Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 66 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

NarrativeQA Helmet benchmark

MiA-Emb-8B + MiA-Gen-14B

49.5F1 Score

9

Feb 26, 2026

NLPAI4Health 2025 (test)

86.7Win Rate

9

Feb 26, 2026

SearchGymBench Complex QA 1.0 (test)

47.6Accuracy

9

Feb 26, 2026

SearchGymBench Simple QA 1.0 (test)

75Accuracy

9

Feb 26, 2026

Natural Questions

1.272PPL

9

Feb 26, 2026

1.408PPL

9

Feb 26, 2026

87Accuracy

9

Feb 26, 2026

MTBench Weather

71.7Accuracy

9

Feb 26, 2026

MTBench Finance

91.3Accuracy

9

Feb 26, 2026

MMLU Health Large Shift (test)

50.6Accuracy

9

Feb 26, 2026

MMLU Law Large Shift (test)

37.9Accuracy

9

Feb 26, 2026

MMLU English Large Shift (test)

44.4Accuracy

9

Feb 26, 2026

MMLU Computer Science Large Shift (test)

46.3Accuracy

9

Feb 26, 2026

ARC-E Small Shift (test)

78.9Accuracy

9

Feb 26, 2026

ARC-C Small Shift (test)

69.5Accuracy

9

Feb 26, 2026

OBQA in-distribution (test)

81.6Accuracy

9

Feb 26, 2026

Single-hop QA (NQ, PopQA, AmbigQA) (test)

59.45F1 (NQ)

9

Feb 26, 2026

Babilong 16k context length

58QA1 Accuracy

9

Feb 26, 2026

SyllabusQA Multi-Document 7

72.4Accuracy

9

Feb 26, 2026

QASPER Multi-Document 4

76.2Accuracy

9

Feb 26, 2026

ContextBench Single-Document Ours

91.5Accuracy

9

Feb 26, 2026

FinanceBench Single-Document 9

84Accuracy

9

Feb 26, 2026

Belebele Non-English

76.84Accuracy

9

Feb 26, 2026

59.37Prog Acc

9

Feb 26, 2026

TimelineQA (test)

36.9Hit@1

9

Feb 26, 2026

Page 66 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact