OlympiadBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OlympiadBench
55.6Pass@1
14
OlympiadBench
71.3Accuracy
14
OlympiadBench Physics
87.3Accuracy
14
OlympiadBench
43Avg Score (avg@1)
13
OlympiadBench ProcessBench (test)
8.2Error
13
OlympiadBench
58.48Pass@1 Accuracy
12
OlympiadBench
65.4Avg@32
12
OlympiadBench
27.76Avg@8 Accuracy
12
OlympiadBench
180Training Steps to Target Accuracy
12
OlympiadBench
55.57Accuracy
12
OlympiadBench
63.1Accuracy
12
OlympiadBench
61.1Accuracy (avg@4)
12
OlympiadBench
75.5Accuracy
12
OlympiadBench
45.2Pass@1
12
OlympiadBench
50.7Avg@16
12
OlympiadBench
36Avg@3
12
OlympiadBench OE_TO_maths_en_COMP
74.04Accuracy
12
OlympiadBench
64Pass@1
12
OlympiadBench terminal answers
0.955AUROC
11
OlympiadBench
0.061ECE
11
OlympiadBench
89.46AUROC
11
OlympiadBench v1 (test)
55Accuracy (avg@1)
11
OlympiadBench
26.6Pass@1 Rate
10
OlympiadBench
49.8Average@8 Score
10
OlympiadBench
60.1Mean Score @8
10