Mathematical Reasoning on GSM8K (Acc, TPS, Speed)
90AccuracySD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SDModel=Qwen, Draft Model=0.5B, Target Model=14B2026.04 | 90 | 170 | — | |
| SMC-SDModel=Qwen, Draft Model=3B, Target Model=14B, Operating Point=iso-accuracy2026.04 | 90 | 233 | 1.37 | |
| SMC-SDModel=Qwen, Draft Model=3B, Target Model=14B, Operating Point=max speed2026.04 | 88.5 | 241 | 1.42 | |
| SMC-SDModel=Llama, Draft Model=1B, Target Model=8B, Operating Point=iso-accuracy2026.04 | 81 | 290 | 1.16 | |
| SDModel=Llama, Draft Model=1B, Target Model=8B2026.04 | 78 | 250 | — | |
| SMC-SDModel=Llama, Draft Model=1B, Target Model=8B, Operating Point=max speed2026.04 | 72 | 380 | 1.52 |