GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
62.97Win Rate
3
GSM8K
93Solve Rate
3
GSM8K
3.3ASR (Depth 3)
3
GSM8K (test)
0.797Final Reward
3
GSM8K (Out-of-distribution)
92Accuracy
3
Gsm8k
48.31Tokens/s
3
GSM8K Constrained
96.8Constraint Satisfaction
3
GSM8K (test)
0.642BCE Loss
3
GSM8K
100Accuracy
3
GSM8K JSON (test)
0.854Structural Accuracy
3
GSM8K
83.2Pass@1 Accuracy
3
GSM8K Zero
99.5ACC
3
GSM8K
84.46Accuracy
3
GSM8K Near-shift OOD
93.39Accuracy
3
GSM8K STREET
94Answer Accuracy
3
GSM8K
0.006MSE
3
GSM8K (saturated)
0.96Best Single Router Performance
2
GSM8K
9.886Accuracy (Prediction D'_pre)
2
GSM8K (test)
68.41GSM8K Accuracy (%)
2
GSM8K
0.93s Score
2
GSM8K
5Positive Seeds Count
2
GSM8K
68.99Accuracy
2
GSM8K 250
88Strict Accuracy
2
GSM8k Tiny
31.7E*S
2
GSM8k (test)
47.8Accuracy
2