Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

SimpleQA dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

SimpleQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Generative Question Answering

SimpleQA

92HALL Score

10

Watermark Detection

SimpleQA

0.81Delta_q

10

Factual Question Answering

SimpleQA (test)

79.07Accuracy

10

Scientific Knowledge and Reasoning

SimpleQA Verified

72.1Score

9

SimpleQA Verified

31.5Score

9

Data Distribution Inference

SimpleQA

0.615DDI AUC

8

Question Answering

SimpleQA

1.236SimpleQA Score

8

SimpleQA

67.8F1 (Avg)

8

Question Answering

SimpleQA Sim

8Accuracy

7

Question Answering

SimpleQA

56.1F1 Score

7

Question Answering

SimpleQA

45.27F1 Score

7

Question Answering

SimpleQA

58.3EM

7

Fact-seeking Question Answering

SimpleQA no web

55Accuracy

7

SimpleQA

35.3Factuality Score

7

Confidence Calibration

SimpleQA (test)

6.8ECE

7

Knowledge-aware refusal

SimpleQA

0.4Delta Accuracy

6

Question Answering

SimpleQA

75.1Accuracy

5

Question Answering

SimpleQA

63.7Accuracy

5

Question Answering

SimpleQA Spanish-pivot CS (test)

17.1ES-ora Score

5

Cross-task decoding accuracy

SimpleQA

100Audience Accuracy

5

Metacognition Steering Evaluation

SimpleQA

0.85Audience Expertise (Δs)

5

Open-ended Question Answering

SimpleQA

60.9Accuracy

5

Question Answering

SimpleQA 50/50 calibration (test)

26.7CR (%)

5

Question Answering

SimpleQA

18.7SECE (%)

5

Knowledge Retrieval

SimpleQA

74.01Accuracy

5

Page 2 of 3

Popular tasks

Question Answering Confidence calibration Short-form Question Answering Open-ended Question Answering Multi-hop Question Answering

Follow for updates

Join SOTA2 Contact