OlympiadBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OlympiadBench
67.03Maj@16
24
OlympiadBench
65.6Pass@16
24
OlympiadBench
81Accuracy
24
OlympiadBench
57.1Pass@1 Accuracy
24
OlympiadBench
0.44Accuracy
24
OlympiadBench
61.2Pass@8
24
OlympiadBench
52Acc@1
23
OlympiadBench
44.25Avg Success Rate @8
23
OlympiadBench
47.1Pass@1
22
OLYMPIADBENCH
65.15Accuracy
21
OlympiadBench
60.9Avg@8
21
OlympiadBench
47.4Pass@1 Accuracy
20
OlympiadBench
71.4Accuracy
20
OlympiadBench
73.8Accuracy (%)
20
OlympiadBench
66.91Pass@1
20
OlympiadBench (test)
42.7Pass@1 Accuracy
19
OlympiadBench
48.2Pass@1 Accuracy
19
OlympiadBench
38.13Accuracy (%)
18
OlympiadBench
36.36Avg@16
18
OlympiadBench (test)
43.2Accuracy
18
OlympiadBench
51.45Avg@4 Accuracy
18
OlympiadBench OE_TO_mat_en_COMP
57.73Accuracy
18
OlympiadBench
12.8Accuracy
18
OlympiadBench
65.78Pass@16
18
OlympiadBench Math
27Pass@1
18