Mathematical Reasoning on GSM8K (Score, ALm, Rej)
93.1GSM8K ScoreCactus 1.0
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cactus 1.0m (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 93.1 | 5.44 | -32 | |
| TASm (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 92.87 | 6.78 | -32 | |
| Cactus 1.0m (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 92.87 | 7 | -34 | |
| TASm (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 92.65 | 5.24 | -30 | |
| Cactus 0.75m (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 92.15 | 7.15 | -36 | |
| Cactus 0.75m (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 92.12 | 5.35 | -31 | |
| SpSm (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 91.89 | 5.11 | — | |
| VerifierVerifier Model=Qwen 3 14B2026.04 | 91.71 | — | — | |
| SpSm (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 91.12 | 4.27 | — |