GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
91.85Accuracy
6
GSM8K
94.5Pass@4
6
GSM8K
94.6Accuracy (GSM8K)
6
GSM8K (test)
95.2Accuracy
6
GSM8K (test)
71.5Hit Score (HS)
6
GSM8K 150 problem Llama-3.1-8B-Instruct (test)
82.67Accuracy (2 hops)
6
GSM8K
63.1EM (%)
6
GSM8K
86.2Accuracy (pass@1/mean@32)
6
GSM8K
13Best-of-16 Delta
6
GSM8K 512
81.2Accuracy
6
GSM8K 128
76.65Accuracy
6
GSM8K
78.2Accuracy
6
GSM8K
78.47Score
6
GSM8K
90Accuracy
6
GSM8K
3.5∆GSM8K (pp)
6
GSM8K (test)
99.3TDR
6
GSM8K
36.7Drop in Utility
6
GSM8K
-7.8Drop in Utility
6
GSM8K Setting a and experimental settings b-f
3Speed Up Ratio
6
GSM8K CoT LLaDA-8B-Instruct (test)
80.51Score
6
GSM8K
76Accuracy
6
GSM8K (test)
91Accuracy
6
GSM8K
23.7Throughput (TPS)
6
GSM8K
96.8Accuracy
6
GSM8K
83.9Accuracy
6