OlympiadBench
Benchmarks
TaskDatasetSOTA resultTrendResults
OlympiadBench
82.44Accuracy
213
OlympiadBench
68.8Accuracy
134
OlympiadBench Math
99.86Accuracy
97
OlympiadBench
90.7Accuracy
76
OlympiadBench
0.766Accuracy
72
OlympiadBench Math (test)
35.9Accuracy
59
OlympiadBench
60.44Accuracy
57
OlympiadBench
65.81Accuracy
57
OlympiadBench
68Accuracy
56
OlympiadBench
78.72Pass@1 Accuracy
51
OlympiadBench
68.32Accuracy
50
OlympiadBench
70.3Accuracy
44
OlympiadBench (test)
57.9Accuracy
40
OlympiadBench
62.1Pass@1
39
OlympiadBench
68.1Pass@1 Accuracy
38
OlympiadBench
56.7Accuracy
38
OlympiadBench
37.86EM Score
36
OlympiadBench
60.67Pass Rate
36
OlympiadBench
57.9EM
36
OlympiadBench
62.8Pass@1
33
OlympiadBench
77.59Score
31
OlympiadBench 675
56.85Accuracy
28
OlympiadBench
73.78Accuracy (avg@4)
26
OlympiadBench
64.6Accuracy
24
OlympiadBench
29.06Average Score @16
24