Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 67 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

65.9Precision

9

Feb 26, 2026

80.08EM Score

9

Feb 26, 2026

NQ 1200 noisy contexts

83.13Unhelpful

9

Feb 26, 2026

Knowns.QA (1,000 samples subset of COUNTERFACT)

14.32Misleading Rate

9

Feb 26, 2026

33.91Accuracy

9

Feb 26, 2026

NarrativeQA Trun. latest (test)

21.34Average Score

9

Feb 26, 2026

G-Retriever w/ LoRA

86.83Accuracy

9

Feb 26, 2026

G-Retriever w/ LoRA

87.05Accuracy

9

Feb 26, 2026

79.02EM

9

Feb 26, 2026

HotpotQA Adversarial

56.8EM

9

Feb 26, 2026

CS-VQLA t=1 to t=2

0Balanced Acc (Old N/O)

9

Feb 26, 2026

CS-VQLA t=0 to t=1

0Balanced Accuracy (Old N/O)

9

Feb 26, 2026

69.51Accuracy

9

Feb 26, 2026

79.16Accuracy

9

Feb 26, 2026

OneStopQA Advanced

64.31Accuracy

9

Feb 26, 2026

49.7F1 Score

9

Feb 27, 2026

TriviaQA Open-domain filtered (test)

79.8Exact Match (EM)

9

Feb 26, 2026

89.5Accuracy

9

Feb 26, 2026

82.4F1 Score

9

Feb 26, 2026

SQuAD-Adversarial AddOneSent 1.1 (dev)

84.5F1

9

Feb 26, 2026

SQuAD-Adversarial AddSent 1.1 (dev)

84.2F1 Score

9

Feb 26, 2026

LongMemEval (100-question sample)

68Accuracy

8

Jun 19, 2026

HotpotQA original questions as queries BEIR

retriever-specific rewrite

46.9Accuracy

8

Jun 16, 2026

BoolQ 200-sample

83.5Accuracy

8

Jun 15, 2026

54.7Exact Match (EM)

8

Jun 12, 2026

Page 67 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact