Mathematical Reasoning on AMC 23 (Accuracy, Length, and Efficiency)
95Accuracy14B model
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| 14B modelSpeculative Model=14B, Protocol=pass@12025.04 | 95 | — | 6,395.4 | — | 55.5 | — | — | |
| 32B modelSpeculative Model=32B, Protocol=pass@12025.04 | 95 | — | 7,106.7 | — | 30.7 | — | — | |
| DR-GRPO2026.07 | 94.3 | — | — | — | — | — | — | |
| GRPO2026.07 | 92.8 | — | — | — | — | — | — | |
| 7B modelSpeculative Model=7B, Protocol=pass@12025.04 | 92.5 | — | 6,093.8 | — | 62.6 | — | — | |
| Speculative ThinkingSpeculative Model=7B, Target Model=32B, Protocol=pass@12025.04 | 92.5 | 0 | 5,116.1 | -16.1 | 48 | 56.4 | 16 | |
| DASH2026.07 | 91.8 | — | — | — | — | — | — | |
| GRPO + Brevity Bonus2026.07 | 91.6 | — | — | — | — | — | — | |
| Nemotron-4BParameters=4B2026.07 | 90.8 | — | — | — | — | — | — | |
| Speculative ThinkingSpeculative Model=1.5B, Target Model=14B, Protocol=pass@12025.04 | 85 | 10 | 7,503.2 | -28.3 | 123.7 | 123 | 19 | |
| Speculative ThinkingSpeculative Model=1.5B, Target Model=32B, Protocol=pass@12025.04 | 80 | 5 | 8,691.2 | -16.9 | 82.8 | 170 | 21 | |
| Deepseek-Distilled Qwen-2.5-1.5BSpeculative Model=1.5B, Protocol=pass@12025.04 | 75 | — | 10,460.8 | — | 212.7 | — | — |