Mathematical Reasoning Suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Mathematical Reasoning Suite AIME 2024, AIME 2025, AMC 2023, HMMT Feb 2025, OlymMath (test)
58.2Accuracy
56
Mathematical Reasoning Suite (AMC, AIME 2024, AIME 2025, Minerva, MATH, Olympiad) various (test val)
62.1Average Score
55
Mathematical Reasoning Suite GSM8K, MATH, SVAMP, SimulEq, AQuA, SAT, MMLU
70.6Accuracy (Aggregate)
40
Mathematical Reasoning Suite (AIME24, AMC23, MATH, MIN., OLY.)
43.3AIME24 Score
31
Mathematical Reasoning Suite MATH 500, AIME 2024, AIME 2025, AMC 2023, Olympiad Bench
76.36Average Score
29
Mathematical Reasoning Suite AIME24, AIME25, AMC23, HMMT24, HMMT25
76.25AIME24 Score
28
Mathematical Reasoning Suite (AIME24, AIME25, MATH, MINERVA, GPQA, GSM8K) Standard (test)
68.75AIME24 Score
26
Mathematical Reasoning Suite MathQA, GSM8K, AddSub, SingleEq, SVAMP
91.88MathQA Accuracy
24
Mathematical Reasoning Suite (AIME24, Math500, Olympiad, AMC, Minerva)
60.58AIME24 Score
23
Mathematical Reasoning Suite (Math500, Gaokao En, Olympiad, GSM8K, AMC23, AIME25, AIME24)
92.8Math500 Score
18
Mathematical reasoning suite AIME24, AMC23, GameOf24 (test)
40AIME24 Accuracy
17
Mathematical Reasoning Suite Overall
63.9Average Score
16
Mathematical Reasoning Suite AIME24, AIME25, AMC23, GSM8K, MATH500
25.9AIME 2024 Score
15
Mathematical Reasoning Suite (MATH500, Olympiad, AMC, AIME24, AIME25, GSM8K) pass@1 (test)
44.4Average Score
14
Mathematical Reasoning Suite (A24, A25, AMC, MATH, Minerva)
52.29A24 Score
13
Mathematical Reasoning Suite (AMC, Minerva, MATH, GSM8K, Olympiad, AIME25, AIME24)
56.46Overall Average Score
12
Mathematical Reasoning Suite AIME25, HMMT-Feb, HMMT-Nov, MATH500, Minerva (test)
61.2AIME25 Accuracy
10
Mathematical Reasoning Suite Aggregate
66.71Average Score
8