GPQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GPQA
69.89Accuracy
7
GPQA Diamond
41.41GPQA-D Accuracy
7
GPQA Diamond (train)
98.52Success Rate
7
GPQA Diamond (test)
60.83Success Rate
7
GPQA Diamond
51.5Accuracy
7
GPQA OOD
64.4Accuracy
7
GPQA D
78EM
7
GPQA
23.89Accuracy (GPQA)
7
GPQA
30.4Accuracy
7
GPQA
31.6Average@4
7
GPQA Diamond
82.8pass@1
7
GPQA
60.9Score
7
GPQA (test)
0.102ECE
7
GPQA Diamond
75.7Accuracy
6
GPQA (test)
49.6Accuracy
6
GPQA Diamond
75.3Initial Accuracy
6
GPQA Diamond
60.5Pass Ratio
6
GPQA Diamond
28.41Precision@1
6
GPQA Diamond
73.4Accuracy (Avg@8)
6
GPQA-D
68.9Accuracy @8
6
GPQA
51Accuracy
6
Super GPQA
51Accuracy
6
GPQA
0.87Spearman's Rho
6
GPQA Diamond
40.4Accuracy
6
GPQA
48Accuracy
6