GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8k
93PR-AUC
19
GSM8K
102.5Retention Percentage
19
GSM8K
85.9Accuracy
19
GSM8K
91.2Pass@3 Accuracy
19
GSM8K-NL (test)
58.5Accuracy
19
GSM8K 0-shot
88.78Pass@1
19
GSM8K In-Domain (test)
94.39Accuracy
18
GSM8K
91.4Accuracy
18
GSM8k
0.571PRR
18
GSM8K
91.43Accuracy
18
GSM8K
90.13Pass@1
18
GSM8K
92.4Accuracy
18
GSM8K
91.3Accuracy
18
GSM8K
96.6Accuracy
18
GSM8K
28.8Delta LL (GSM8K)
18
GSM8K
89.9Accuracy
18
GSM8K
94.4Solve Rate
18
GSM8K (test)
89.3Accuracy
18
GSM8K 100 examples
5.47Speed-up
18
GSM8K
94.6Accuracy
18
GSM8K
39.37Accuracy (%)
18
GSM8K PRO
95Accuracy
18
GSM8K
93.1Accuracy (Strict)
18
GSM8K
83.6Accuracy
18
GSM8K
92.27Pass@1
18