GSM8K
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM8K
94.39Task Accuracy
9
GSM8K
38.7nR2
9
GSM8K
0.3Accuracy Degradation (Δ)
9
GSM8K
5.28SpeedUp
9
GSM8K
89.31Accuracy (GSM8K)
9
GSM8K
88Coverage
9
GSM8K ZH
92.57Accuracy
9
GSM8K
83.4Pass@1 Accuracy
9
GSM8K
48.3Accuracy
9
GSM8K
94.1Pass@1 Accuracy
9
GSM8K
90.4Random Baseline
9
GSM8K
33.21Accuracy (maj@2)
9
GSM8K
64.52Accuracy (maj@2)
9
GSM8K 256
81.58Accuracy
9
GSM8K
95.9Exact Match Accuracy
9
GSM8K (test)
90.98Accuracy
9
GSM8K
92.6Accuracy (GSM8K)
9
GSM8K
98.9FRS
9
GSM8K 8B Instruct (test)
58.6Accuracy
9
GSM8K
93.1GSM8K Score
9
GSM8K (n=300)
68.8Accuracy @73.7%
9
GSM8K Track I
88.02Overall GSM8K Accuracy
9
GSM8K-Format
99.2Final Accuracy
9
MR-GSM8K
92Accuracy
9
GSM8K
47.23EM Accuracy
9