GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
6.77MAT (Accuracy)
15
GSM8K
0.987AUC
15
GSM8K
96.6Accuracy
15
GSM8K (test)
0.924Accuracy
15
GSM8K
95.1Accuracy
15
GSM8K
0.773vbal Score
15
GSM8K
89.6Accuracy (GSM8K)
15
GSM8K
2.414Speedup Ratio
15
GSM8K 4-shot (test)
54.6Throughput
15
GSM8K (test)
96.36AVG@8
15
GSM8k 512 tokens
82.6Pass@1
15
GSM8k 256 tokens
81.2Pass@1
15
GSM8K
96.66p@1 Accuracy
15
GSM8K 20 (test)
1.39Speedup (x)
15
GSM8K
91.6Pass@1
15
GSM8K Depth +4 (test)
45.5Accuracy
15
GSM8K Depth +2 (test)
62.5Accuracy
15
GSM8K Width +2 (test)
75Accuracy
15
GSM8K Numerical +8 (test)
67.8Accuracy
15
GSM8K
83.3ACC
15
GSM8k
88.7Accuracy
14
GSM8K TASA TACQ (test)
83.1Accuracy
14
GSM8K Verification
85.5Accuracy
14
GSM8K
7.82Speedup
14
GSM8K
96.51Accuracy
14