GSM8K
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM8K
96.81Accuracy
14
GSM8K
91.28Accuracy
14
GSM8k 4 options (test)
50.3Accuracy
14
GSM8K
8.08Speedup
14
GSM8K (test)
96.61Accuracy
14
GSM8K
88.2Accuracy (pass@1)
14
GSM8K
92Accuracy (ACC)
14
GSM8K CoT
451.8Throughput (H200 TPS)
14
GSM8k
64.2PRR (Accuracy)
14
GSM8K
38.6Pass@1
14
GSM8K
90.8Accuracy
14
GSM8K
89.99Accuracy (GSM8K)
14
GSM8K
91.66Accuracy
14
GSM8K
85.7Accuracy
14
GSM8K (test)
3.903Speedup Ratio
14
GSM8K
1Relative Cost
14
GSM8K MC
95.68Accuracy
14
GSM8K
58.76GSM8K Accuracy
14
GSM8K
87.64Pass@1
14
GSM8K (test)
52Latency (min)
14
GSM8K (held-in)
68.31Performance (%)
14
GSM8K
81Accuracy
13
GSM8K
70.85Avg@8 Score
13
GSM8K
1.026Normalized performance
13
GSM8K
92.95Accuracy
13