Olympiad
Benchmarks
TaskDatasetSOTA resultTrendResults
Olympiad
70.9Accuracy
137
Olympiad
46.1Accuracy
136
Olympiad
73.2Accuracy
90
Olympiad
68.3Pass@1 Accuracy
73
Olympiad
60.5Pass@1 Accuracy
60
Olympiad
69.8Pass@1
50
Olympiad
70.7Avg@16 Accuracy
47
Olympiad
65.2Pass@1
41
Olympiad
65.6Average Rate @16
38
Olympiad
68.6Pass@1
30
Olympiad (test)
52.1Accuracy
27
Olympiad
50Performance (%)
26
Olympiad
47.1Pass@k
24
Olympiad
49.6Pass@k
24
Olympiad
46.78Avg@k
24
Olympiad
68.55Accuracy
24
Olympiad
61.2Accuracy (%)
21
Olympiad
40.86P@1
20
Olympiad
55.8Avg@4
20
Olympiad
54.89Pass@1
20
Olympiad
52.3Pass@1
20
Olympiad
54.4Pass@1
19
OLYMPIAD
42.2Pass@1 Score
18
Olympiad
31.6Pass@1
18
Olympiad
42.4Pass@1
18