gsm
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
97.8Accuracy
9
GSM Hard
52.69Accuracy
9
GSM Hard
53.4Pass@1 Success Rate
9
GSM-Symbolic
0.435LB
8
GSM DE
66Accuracy
7
GSM CoT
83.2Accuracy (GSM CoT)
7
GSM Reversed
90.3Accuracy
7
GSM-SYS
80.9Accuracy
7
gsm
6,178Execution Cycles
7
GSM-Hard
63.28Accuracy
6
GSM Hard
71.5Accuracy
5
GSM-Hard GSM8k-Aug rationale format (original)
13.04Pass@1
5
GSM-Hard
15.83Pass@1
5
GSM MC
3.75FPR
5
GSM-Hard
69.94Accuracy
4
GSM
72.7Accuracy
4
GSM
48.9Win Rate
1
GSMPlus
0.49Trial Success Rate
1