Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

GPQA dataset and benchmarks – Page 20 · SOTA2 Research

Research Datasets

GPQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

GPQA Diamond (test)

34.85Accuracy

4

Scientific Question Answering

GPQA

54.7Accuracy

4

Graduate-level Science Question Answering

GPQA-D

23.4Accuracy

4

General Reasoning

GPQA D

27.3Accuracy

4

General Reasoning

GPQA

25.8Accuracy

4

Scientific Reasoning

GPQA

27Accuracy

4

General Knowledge

GPQA Diamond

68.18Pass@3

4

Knowledge & STEM

GPQA Diamond

84.2Pass@1 Score

4

Question Answering

GPQA

33Log Accuracy

4

Predictive memory allocation

GPQA Diamond

39.87#Allocs

4

GPQA Diamond In-Distribution (test)

80.36CPT (90%)

4

GPQA-Diamond OOD

74.3CPT Accuracy (85%)

4

GPQA Diamond

89.19CPT (95%)

4

GPQA Diamond

82.54CPT (90%)

4

GPQA Diamond (ID)

62.69CPT (80%)

4

GPQA Diamond (ID queries)

71.53CPT (85%)

4

GPQA Diamond

90.78CPT (95%)

4

GPQA Diamond

0.747Hypervolume

4

GPQA Diamond OOD

66.05CPT (80%)

4

Science Reasoning

GPQA-Diamond (test)

0.751Hypervolume

4

General Reasoning

GPQA Diamond

31.5Avg@8

4

GPQA

31.7Inference Time (s)

4

Scientific Question Answering

GPQA

27Score

4

Medical Question Answering

GPQA

66.67Accuracy

4

Question Answering

GPQA

19.7ANLL

4

Page 20 of 23

Popular tasks

Scientific Reasoning Question Answering Science Question Answering Reasoning Science Reasoning

Follow for updates

Join SOTA2 Contact