Mathematical Reasoning Benchmarks
Benchmarks
TaskDatasetSOTA resultTrendResults
Mathematical Reasoning Benchmarks (GSM8K, MATH, AMC23, Olympiad, Minerva) (test)
94GSM8K Accuracy
32
Mathematical Reasoning Benchmarks (GSM8K, MATH500, AMC, Olympiad Bench, AIME) (test)
85.3GSM8K Accuracy
28
Mathematical Reasoning Benchmarks AIME24, MATH500, Olympiad, AMC, Minerva (test)
33.3AIME24 Score
22
Mathematical Reasoning Benchmarks AIME24, AIME25, HMMT25 2024/2025 (test)
78.33Accuracy on AIME 2024
20
Mathematical Reasoning Benchmarks GSM8K, MATH500, ASDiv, SVAMP, AMC23 (test)
81.96GSM8K Accuracy
20
Mathematical Reasoning Benchmarks
88.1Average Score
20
Mathematical Reasoning Benchmarks (AddSub, AQuA, GSM8k, MultiArith, SingleEq, SVAMP) (test)
96.96Accuracy (AddSub)
18
Mathematical Reasoning Benchmarks (test)
53.72Average Score
16
Mathematical Reasoning Benchmarks Average
71.88Pass@4 Score
14
Mathematical Reasoning benchmarks GSM8K, MATH 500, Minerva, College Math, Olymp., AIME 24, AIME 25
96.84GSM8K Accuracy
12
Mathematical Reasoning benchmarks GSM8K, AddSub, AQuA, MultiArith (test)
79.03GSM8K Accuracy
12
Mathematical Reasoning Benchmarks (AIME24, AIME25, MATH500, AMC23, GSM8K, Minerva)
15.42AIME24 Accuracy
9
Mathematical Reasoning Benchmarks Average
78.1Accuracy
9
Mathematical Reasoning Benchmarks (AIME, HMMT, MATH500, AMC, O-Bench) (test)
34.2AIME 2024 Score
6
Mathematical Reasoning Benchmarks AIME24, AMC23, MATH500
15AIME24 Score
6
Mathematical Reasoning benchmarks (GSM8K, SingleEq, SVAMP, MultiArith, AddSub, AQuA, MAWPS) out-of-domain (evaluation)
16.1GSM8K Accuracy
5
Mathematical reasoning benchmarks
0.32Forward Pass Time (s)
4
Mathematical Reasoning Benchmarks (MATH, AIME25, AMC, MINERVA, KAOYAN, OLYMPIAD, CN_MATH24)
91.1MATH Accuracy
4
Mathematical Reasoning Benchmarks AIME24, Math500, Olympiad, AMC, Minerva
15.6AIME24 Score
3
Mathematical Reasoning Benchmarks AIME 24, AIME 25, AMC, Minerva, MATH-500, Olympiad, Gaokao23 (test)
43.3AIME 2024 Score
3