Mathematics
Benchmarks
TaskDatasetSOTA resultTrendResults
MATHEMATICS
74.1Accuracy
46
Mathematics out-of-domain (test)
75.9Accuracy
30
Mathematics
85.9Accuracy
24
Mathematics user-disjoint
64Main Score
20
Mathematics
65.8Pass@1
18
Mathematics In-Distribution (AIME25, AMC23, Minerva, MATH500, Olymp.)
39.7AIME25 Accuracy
16
Mathematics Amazon (test)
31.4R@50
15
Mathematics
71.22PREC@1
14
Mathematics
47.1NDCG@5
14
Mathematics
100Normalized Score
9
Mathematics (overall)
5.139Mean Borda Score
8
Mathematics Circle-Packing
2.636Score
7
Mathematics Grouped General-Purpose Metrics
70.56Mathematics Score
3
Mathematics MinMaxMinDist
4.166Score
3
Mathematics (val)
556.73Perplexity
2
Mathematics Task
30Token Match Rate
2