gsm
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM-Hard
99Accuracy
169
GSM-Hard
78Solve Rate
162
GSM Hard
82.6Accuracy
73
GSM PRO
100Accuracy
72
GSM-Hard
89.52Accuracy
70
GSM
94Accuracy
70
GSM-Hard
53.4Accuracy
64
GSM→FOL
85.8Accuracy
45
GSM-sym
90.22Exact Match
44
GSM (test)
65.4Accuracy
42
GSM-Hard
69.6GSM-Hard pass@1 Acc
40
GSM Hard
68.6Accuracy
31
GSM-Plus
90.7Score
28
GSM
92.16GSM Accuracy
27
GSM
61Accuracy
27
GSM-PLUS
76.54Accuracy
25
GSM-Hard
48.57Accuracy (GSM-Hard)
24
GSM-Hard
64.6Accuracy
18
GSM-ICM
92.7Accuracy
16
GSM Hard
10.8Accuracy
15
GSM-H (held-out)
57.54Accuracy (%)
14
GSM
82.18Pass@1 Accuracy
13
GSM Hard
62Accuracy
12
GSM 8K
97.77pass@K
12
RLVR-GSM
0.011Multiplicative Gap (ε)
12