GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
90.45GSM8K Score
7
GSM8k
79.17Accuracy
7
GSM8K MINCE Calibration n=400
74.5Accuracy
7
GSM8K
84.3Accuracy (%)
7
GSM8K
1Spearman Rho (Agreement)
7
GSM8K
0.986Performance (Scale 1e-5)
7
GSM8K FLORES-200 (10 low-resourced languages) (test)
67.93Kazakh (Cyrl) Accuracy
7
GSM8K
6.1Accuracy
7
GSM8K
52.45Accuracy
7
GSM8K (test)
79.68Accuracy
7
GSM8k
87Utility
7
GSM8K
94.26Accuracy (avg@K)
7
GSM8K (test)
23.19Accuracy
7
GSM8K 200 held-out questions
90.4Accuracy
7
GSM8K
0.87AUROC
7
GSM8K
0.42Occ Score
7
GSM8K
96.2Accuracy
7
GSM8K FR (test)
64Accuracy
7
GSM8K ES (test)
72Accuracy
7
GSM8K DE (test)
66Accuracy
7
GSM8K ZH (test)
58Accuracy (ZH)
7
GSM8K
97.8Accuracy
7
GSM8K
58.4Accuracy
7
GSM8K
95.3Accuracy
7
GSM8K
92.55GSM Score
7