MATH500
Benchmarks
TaskDatasetSOTA resultTrendResults
MATH500
87.2Pass@1 Rate
66
Math500 Level 5
71.1Accuracy
54
MATH500 In-Domain (test)
86.2Accuracy
18
Math500 512 tokens
46.3Pass@1 Accuracy
15
Math500 256 tokens
41.2Pass@1 Accuracy
15
MATH500 random subset of 128 samples
71.09Top-1 Accuracy
12
MATH500
96.4MATH500 Average Score
12
Math500
45.4Score
11
MATH500
85.6Pass@1
10
MATH500
76.8Accuracy @ First Step
9
MATH500 (test)
0.94Accuracy
9
Math500 (in-domain)
95.2Accuracy
5