Mathematical Reasoning on GSM8K (Accuracy, Token Usage, Flips)
94.54AccuracyLong base, 8,192 limit
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Long base, 8,192 limitPolicy=Long base, 8,192 limit2026.06 | 94.54 | 0 | 1,157 | 0 | |
| SELECTIVE ACTIVE VERIFYPolicy=SELECTIVE ACTIVE VERIFY2026.06 | 94.47 | 3 | 1,335 | 0 | |
| Base, 4,096 limitPolicy=Base, 4,096 limit2026.06 | 93.4 | 0 | 1,180 | 0 | |
| Always active verifyPolicy=Always active verify2026.06 | 93.4 | 100 | 2,932 | 1.25 |