Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 74 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0.614BLEU-1

8

Feb 26, 2026

44.1BLEU-1

8

Feb 26, 2026

0.9µbias

8

Feb 26, 2026

2.8Mu Bias (STEM)

8

Feb 26, 2026

66.67Accuracy

8

Feb 26, 2026

Specialized Knowledge Tasks (ARC-C, SciQ, PubMedQA, MathQA, MMLU) zero-shot

WRAP (Synthetic+C4)

29.9ARC-C

8

Feb 26, 2026

27.7Accuracy

8

Feb 26, 2026

40EM

8

Feb 26, 2026

79.99SQuAD 2

8

Feb 26, 2026

88.13Accuracy

8

Feb 26, 2026

36.14Accuracy

8

Feb 26, 2026

RAG (Open-domain)

45.5Accuracy

8

Feb 26, 2026

50.37EM

8

Feb 26, 2026

MLQA G-XLT v1.0 (test)

67.7Avg Score

8

Feb 26, 2026

XQuAD v1.1 (test)

89F1 (en)

8

Feb 26, 2026

WikiQA standard (test)

45.5MRR

8

Feb 26, 2026

QASPER Extractive (test)

53.3F1

8

Feb 26, 2026

QASPER Extractive (dev)

29.6F1

8

Feb 26, 2026

0.832MAP

8

Feb 26, 2026

MMQA QE-PE 5.2 (test)

m-BERT based MMC

55.64EM

8

Feb 26, 2026

75.9Accuracy

8

Feb 26, 2026

bAbI 1K examples 1.0 (test)

Universal Transformer with dynamic halting

4.55Average Error Rate

8

Feb 26, 2026

46.2EM

8

Feb 26, 2026

79.2Accuracy

8

Feb 26, 2026

HotpotQA 1.0 (dev)

77.2EM

8

Feb 26, 2026

Page 74 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact