GSM8K
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM8K
97.1Accuracy
1,424
GSM8K (test)
99Accuracy
954
GSM8K (test)
98.8Accuracy
816
GSM8K
98Accuracy
499
GSM8k
100Accuracy
388
GSM8K
97.8Accuracy (GSM8K)
358
GSM8K
96.81Accuracy (Acc)
352
GSM8K (test)
95.9Accuracy
276
GSM8K
97.1Accuracy
272
GSM8K
98.87Accuracy
254
GSM8K
0.988Accuracy
248
GSM8K
13.4Speed Up (x)
246
GSM8K
95.38GSM8K Accuracy (%)
220
GSM8K
0MAE
204
GSM8K (test)
97.35Accuracy
203
GSM8K
96.4Math Score
197
GSM8K
97.54Accuracy
192
GSM8K
100Accuracy (GSM8K)
190
GSM8K
98Accuracy (GSM8K)
186
GSM8K
97Accuracy
166
GSM8K
95.3Accuracy
158
GSM8K
90.37AUROC
131
GSM8K
84Accuracy
130
GSM8K
93.8Accuracy
126
GSM8K
97.04EM
123