GPQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GPQA
69.4GPQA Score
27
GPQA Diamond
44.44Solve Rate
27
GPQA diamond
72.5Accuracy
25
GPQA
72.1Accuracy (%)
25
GPQA
61.7Best Accuracy
25
GPQA
87Performance Score
25
GPQA Diamond
63.1Accuracy
24
GPQA
73.74Accuracy
24
GPQA
30.9r* Accuracy
24
GPQA-D
69.5Accuracy
24
GPQA
62.6Accuracy
24
GPQA
93.5Accuracy
24
GPQA
86Pass@k
24
GPQA D
63.2Accuracy
24
GPQA
2.7Inference Latency (s)
24
GPQA
0.21Memory Ratio
24
GPQA
31.03Accuracy
24
GPQA
31.06Performance
24
GPQA Diamond
63.54Pass@1 Accuracy
23
GPQA Diamond (test)
81.5Accuracy
23
GPQA
63Accuracy
22
GPQA D
49.49GPQA-D Score
22
GPQA Diamond
53.03Accuracy (ACC)
22
GPQA Diamond
53Accuracy (pass@1)
22
GPQA-D
68.2Accuracy
22