Mathematical Reasoning on AMC 23 (Pass@1, TPS, Latency)
92.5Pass@1Target Model
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Target ModelDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 92.5 | 34.78 | 154.34 | |
| Target ModelDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 92.5 | 40.62 | 165.02 | |
| SemanticSpecDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 89.2 | 120.58 | 49.29 | |
| SemanticSpecDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 89.2 | 85 | 75.42 | |
| SpecReasonDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 85.7 | 64.52 | 98.59 | |
| SpecSamplingDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 84.2 | 65.73 | 91.4 | |
| SpecSamplingDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 82.5 | 58.53 | 120.39 | |
| SpecReasonDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 77.5 | 125.92 | 49.98 | |
| Draft ModelDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 65.8 | 378.3 | 19.59 | |
| Draft ModelDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 65.8 | 378.3 | 19.59 | |
| SpecThinkingDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 65 | 284.59 | 24.99 | |
| SpecThinkingDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 61.4 | 309.55 | 30.2 |