Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 94 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

1.041Rel. Perf vs Truncated ICL

5

Feb 26, 2026

Hadith QA (test)

97.85EM

5

Feb 26, 2026

Sahih al-Bukhari and Sahih Muslim Hadith QA dataset (val)

6.2Training Time (hours)

5

Feb 26, 2026

OOD Benchmarks Macro Average

32.26Accuracy

5

Feb 26, 2026

43.36Accuracy

5

Feb 26, 2026

26.58Accuracy

5

Feb 26, 2026

28.88Accuracy

5

Feb 26, 2026

HotpotQA (test)

60Exact Match (EM)

5

Feb 26, 2026

HotpotQA (test)

0.77LLM Judge Score

5

Feb 26, 2026

50LLM-as-a-Judge Score

5

Feb 26, 2026

0Indexing Time (s)

5

Feb 26, 2026

41.65F1 (Answer)

5

Feb 26, 2026

70.01AvgQA Score

5

Feb 26, 2026

pplx-embed-v1-0.6B

70Match

5

Feb 26, 2026

pplx-embed-v1-4B

91.9Match Score

5

Feb 26, 2026

pplx-embed-v1-4B

51.9Match

5

Feb 26, 2026

pplx-embed-v1-4B

67.7Match Score

5

Feb 26, 2026

94.9QA-Causal Score

5

Feb 26, 2026

MLQA German (de)

65.81F1 Score

5

Feb 26, 2026

MLQA English (en)

84.32F1 Score

5

Feb 26, 2026

BBQ disambiguated questions

93Accuracy

5

Feb 26, 2026

BBQ (ambiguous)

95Accuracy

5

Feb 26, 2026

3GPP 10% compressed Baseline Sampling (BS) (test)

77.72Accuracy

5

Feb 26, 2026

3GPP 10% compressed SFT Sampling (test)

72.52Accuracy

5

Feb 26, 2026

3GPP full original (test)

71.34Accuracy

5

Feb 26, 2026

Page 94 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact