Math Reasoning Suite
Benchmarks
TaskDatasetSOTA resultTrendResults
Math Reasoning Suite Average
63Average Accuracy
49
Math Reasoning Suite Arithmetic Mean
78.1Average Score (@16)
15
Math Reasoning Suite MATH, GSM, AIME
80.1MATH Score
14
Math Reasoning Suite (Math500, AIME24, AMC, Gaokao, Minerva Math, Olympiad Bench)
93.2Math500 Score
12
Math Reasoning Suite AIME, AMC, MATH, Minerva, Olympiad (test)
21.4Avg@8 (AIME)
8
Math Reasoning Suite (MATH, AIME25, AMC, MINERVA, KAOYAN, OLYMPIAD, CN_MATH24)
92.2MATH Accuracy
6
Math Reasoning Suite (GSM8K, MATH500, AIME25, AIME26, AMC, Olympiad) (test)
93.6GSM8K Score
4