MATH
Benchmarks
TaskDatasetSOTA resultTrendResults
MATH 500
95.2Accuracy
21
MATH500 Level-5
67.4Pass@1 Rate
21
MATH 500
78.2Accuracy (mean@4)
21
MATH 500
66.2Pass@1
21
Math
61.1pass@8
21
MATH-500
99.3Accuracy
21
MATH 500
93.6Accuracy
21
MATH500
85.88MATH500 Score
21
MATH
87.3MATH1 Score
21
MATH500
82.63Accuracy
21
MATH-500 (train)
45.2Accuracy
21
Math500
2.84Speedup
21
MATH-500
62.4Accuracy @ 128
21
MATH 500
265.53AUPC
20
MATH500
92.1Accuracy (ACC)
20
MATH (test)
17.31Accuracy
20
MATH500
85.4Mean@32
20
MATH 500
86.2BA @20
20
MATH500
75.5Accuracy
20
MATH500
80.8P@1
20
MATH500
0.378Test Accuracy (%)
20
MATH-lighteval (M-LEval) (test)
95.6Accuracy
20
MATH 500
66.8Pass@4
20
MATH
82Accuracy
20
MATH-500
88.7Pass@1
20