OlympiadBench
Benchmarks
TaskDatasetSOTA resultTrendResults
OlympiadBench
45.69BoN@3 Accuracy
17
OlympiadBench
53.66Best-of-N Accuracy
17
OlympiadBench
7ECE
17
OlympiadBench
1,551.33AUTC Score
17
OlympiadBench
76.4Average Score
17
OlympiadBench
73.3Accuracy (Pass@1)
17
OlympiadBench
37.6Accuracy
16
OlympiadBench
71.5Accuracy
16
OlympiadBench
70.7Pass@1 Accuracy
16
OlympiadBench
62.7Pass@1 Accuracy
16
OlympiadBench
41.82Avg@32
16
OlympiadBench
59.85Accuracy
16
OlympiadBench
73.6Pass@16
16
OlympiadBench (OLY.)
38.2Pass@1
16
OlympiadBench
39.18Avg@k
15
OlympiadBench
61.12Pass@1
15
OlympiadBench
58.93Avg@5 Accuracy
15
OlympiadBench (test)
51.8@1 Success Rate
15
Olympiadbench
60.6Average@16
15
OlympiadBench
64.76Pass@3
14
OlympiadBench
28.2Pass@1 Rate
14
OlympiadBench
60.9Mean@32 Accuracy
14
OlympiadBench
71Accuracy
14
OlympiadBench
50.24Mean Accuracy
14
OlympiadBench Math
1Relative Cost
14