Mathematical Reasoning on AIME 24 (Pass@1, TPS, Latency)
63Pass@1Target Model
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Target ModelDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 63 | 40.62 | 250.75 | |
| Target ModelDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 62.1 | 41.03 | 214.76 | |
| SpecReasonDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 61 | 45.96 | 205.7 | |
| SemanticSpecDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 61 | 86.79 | 119.06 | |
| SemanticSpecDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 55.3 | 116.32 | 86.75 | |
| SpecSamplingDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 54 | 34.25 | 316.19 | |
| SpecReasonDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 47 | 80.95 | 124.61 | |
| SpecSamplingDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 44.3 | 53.29 | 191.45 | |
| SpecThinkingDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 24.1 | 272.79 | 37.09 | |
| Draft ModelDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 23.3 | 380.67 | 29.45 | |
| Draft ModelDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 23.3 | 380.67 | 29.45 | |
| SpecThinkingDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 20.4 | 285.2 | 45.87 |