SuperGPQA
Benchmarks
TaskDatasetSOTA resultTrendResults
SuperGPQA
72.7Overall Score
35
SuperGPQA
50.1Mean@1
34
SuperGPQA
37.77Accuracy (General Reasoning)
27
SuperGPQA (test)
77.7Pass@1
25
SuperGPQA
7,262Length
24
superGPQA
39.3Accuracy (superGPQA)
24
SuperGPQA Code SGPQA-1k
47.4Accuracy
24
SuperGPQA SGPQA-1k Math
46.5Accuracy
24
SuperGPQA MCQA
63.83Accuracy
21
SuperGPQA
48.2pass@1
19
superGPQA
33.6Average Accuracy
18
SuperGPQA
38.4Pass@1
17
SuperGPQA
32Pass@1 Accuracy
16
SuperGPQA
28.46Avg@k
15
SuperGPQA (test)
40.2Accuracy
15
SuperGPQA
44.7Accuracy
15
SuperGPQA
36Pass@1
14
SUPERGPQA (val)
0.776Top-1 Acc
14
SUPERGPQA
77.6Top-1 Acc
14
SuperGPQA*
62.4Accuracy
12
SuperGPQA
28.46Avg@k
12
SuperGPQA Clinical
35.71Accuracy
12
SuperGPQA Law
43.8Accuracy
10
SuperGPQA
34.51Pass@1
8
SuperGPQA
35.59Score
8