Mathematical Reasoning on GSM8K (P@4, #Tok)
94.5Pass@4Vanilla LLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla LLM2026.05 | 94.5 | 2,100 | |
| CRISP2026.05 | 94.3 | 1,700 | |
| MPD2026.05 | 94.2 | 1,400 | |
| Direct Comp.2026.05 | 94.1 | 1,200 | |
| LiteCoT2026.05 | 52 | 1,200 | |
| Chain-of-Draft2026.05 | 42.8 | 600 |