Olympiad
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Olympiad
42.13Pass@1
7
Olympiad
47.64Average Score @16
6
Olympiad standard (test)
38.6Pass@1
6
Olympiad
8Solved Rate
6
Olympiad Plane Geometry 1.0 (test)
0.66Output Tokens (Thousands)
6
Olympiad
40.31Accuracy
6
Olympiad
56.34Acc@8
6
Olympiad
39.8Acc@16
6
Olympiad
49.59Avg@32 Accuracy
6
Olympiad
43.06Average Score @8
5
Olympiad
46.38Pass@1
5
Olympiad
1.45Avg Rank
5
Olympiad
63.2Pass@1 Mean
5
Olympiad
50.29Pass@8
4
Olympiad 19
28Proof Length
4
Olympiad OpenR1-Math Harder Subset
68.1Accuracy
3
Olympiad
45Avg@32
2
Olympiad
—Pass@1 Accuracy
0