OlympiadBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OlympiadBench
45.5Avg@4 Score
10
OlympiadBench
67.6Pass@4
10
OlympiadBench (test)
99.63Math Accuracy
10
OlympiadBench
83.6Accuracy
9
OlympiadBench
71.5Accuracy
9
OlympiadBench
60Accuracy
9
OLYMPIADBENCH
9.78Pass@1
9
OlympiadBench
60.8Avg@4 Score
9
OlympiadBench
63.26Pass@8
9
OlympiadBench Phys
14.41Accuracy
8
OlympiadBench
81.9Pass@1
8
OlympiadBench 675 samples
19.37Accuracy
8
OlympiadBench
56.97Acc
8
OlympiadBench
34.69Accuracy
8
OlympiadBench
51.63Last Score
8
OlympiadBench
38.3Accuracy (%)
7
OlympiadBench
45.5Accuracy
7
OlympiadBench
69.8Pass@1
7
OlympiadBench
61.67Accuracy
6
OlympiadBench
53.4Accuracy
6
OlympiadBench
66.8Accuracy
6
OlympiadBench
48.19Pass@1
6
OlympiadBench-Geo olympiad level
77.68Accuracy
6
OlympiadBench
22.53Accuracy
6
OlympiadBench
52.1Pass@1
5