MATH
Benchmarks
TaskDatasetSOTA resultTrendResults
MATH500 (test)
60.9Accuracy
922
MATH
95.63Accuracy
882
MATH 500
99.1Accuracy (Acc)
600
MATH 500
99.1Accuracy
589
MATH
94.2Accuracy
535
MATH 500
96.4Top-1 Accuracy
452
MATH 500
98.4Accuracy
442
MATH (test)
94.13Overall Accuracy
433
MATH
96.67Accuracy
338
MATH 500
96Pass@1 Rate
274
MATH 500
97.3pass@1
239
MATH
97.6Accuracy
229
MATH Hard
92.8Accuracy
208
MATH 500
97.75Accuracy
183
MATH
95.1MATH Accuracy
172
MATH L5
0.859Accuracy
162
MATH
90.54Accuracy
160
MATH (test)
94.8Pass@1
151
MATH 500
94.8Accuracy (pass@1)
134
Math500
88.2Accuracy (ACC)
133
MATH500
95.6Accuracy
127
MATH-500
99.2Accuracy
126
MATH500
96.23Accuracy
124
MATH 500
97.3Pass@1
122
MATH-500
97.6Accuracy
119