GPQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GPQA Diamond
47.16Mean@32
10
GPQA Diamond
66.16Accuracy
10
GPQA
57.3Score
10
GPQA Diamond
45.3Average@8 Score
10
GPQA Diamond
68.56Average@4
10
GPQA Main
34.6Pass@1
10
GPQA Extended
31.1Pass@1 Accuracy
10
GPQA
33.27Avg.@8
10
GPQA
42.86Accuracy
10
GPQA-D (test)
68.7Accuracy
10
GPQA Diamond
82.1AUROC
10
GPQA Diamond
57.68Accuracy
10
GPQA
24.6Mean Accuracy
10
GPQA
36.16Accuracy
10
GPQA Diamond
78Score
10
GPQA-Diamond 5-shot
57.3Accuracy
10
GPQA Diamond
72.7Accuracy (MV)
9
GPQA Diamond
94.3Avg@16
9
GPQA-D (test)
36.6Score (%)
9
GPQA Diamond
80.3Accuracy
9
GPQA Diamond n=198
87.4Accuracy
9
GPQA Diamond (OOD) (test)
89.84Accuracy
9
GPQA Diamond
63.1Accuracy
9
GPQA Diamond
81.2BCA
9
GPQA 5-shot
33.3Accuracy
9