Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

SimpleQA dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

SimpleQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Question Answering

SimpleQA

87.7Accuracy

4

Agent Trajectory Performance

SimpleQA (test)

77.1Pass@1 Accuracy

4

Scientific Reasoning

simpleQA

16.82Score

3

Open-domain Factual Question Answering

SimpleQA

3.07Accuracy

3

Question Answering

SimpleQA (test)

4.05SimpleQA Score

3

SimpleQA

4Accuracy

2

Confidence calibration

SimpleQA (held-out questions)

2Computational Cost (Generations Factor)

1

Question answering

SimpleQA (200 random samples)

0.981Alignment Score

1

Page 3 of 3

Popular tasks

Question Answering Confidence calibration Short-form Question Answering Open-ended Question Answering Multi-hop Question Answering

Follow for updates

Join SOTA2 Contact