List your company

Mathematical Reasoning Suite

Benchmarks

TaskDatasetSOTA resultTrendResults
Mathematical Reasoning Suite AIME 2024, AIME 2025, AMC 2023, HMMT Feb 2025, OlymMath (test)
58.2Accuracy
56
Mathematical Reasoning Suite (AMC, AIME 2024, AIME 2025, Minerva, MATH, Olympiad) various (test val)
62.1Average Score
55
Mathematical Reasoning Suite GSM8K, MATH, SVAMP, SimulEq, AQuA, SAT, MMLU
70.6Accuracy (Aggregate)
40
Mathematical Reasoning Suite MATH 500, AIME 2024, AIME 2025, AMC 2023, Olympiad Bench
76.36Average Score
29
Mathematical Reasoning Suite (AIME24, AIME25, MATH, MINERVA, GPQA, GSM8K) Standard (test)
68.75AIME24 Score
26
Mathematical Reasoning Suite MathQA, GSM8K, AddSub, SingleEq, SVAMP
91.88MathQA Accuracy
24
Mathematical Reasoning Suite (AIME24, Math500, Olympiad, AMC, Minerva)
60.58AIME24 Score
23
Mathematical Reasoning Suite (Math500, Gaokao En, Olympiad, GSM8K, AMC23, AIME25, AIME24)
92.8Math500 Score
18
Mathematical Reasoning Suite (MATH500, Olympiad, AMC, AIME24, AIME25, GSM8K) pass@1 (test)
44.4Average Score
14
Mathematical Reasoning Suite (AMC, Minerva, MATH, GSM8K, Olympiad, AIME25, AIME24)
56.46Overall Average Score
12
Mathematical Reasoning Suite AIME25, HMMT-Feb, HMMT-Nov, MATH500, Minerva (test)
61.2AIME25 Accuracy
10