Mathematical Reasoning on MATH500 (Acc, TPS, Speed)
79Accuracy (MATH500)SMC-SD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SMC-SDModel=Qwen, Draft Model=3B, Target Model=14B, Operating Point=iso-accuracy2026.04 | 79 | 240 | 1.2 | |
| SDModel=Qwen, Draft Model=0.5B, Target Model=14B2026.04 | 75 | 200 | — | |
| SMC-SDModel=Qwen, Draft Model=3B, Target Model=14B, Operating Point=max speed2026.04 | 74 | 270 | 1.35 | |
| SMC-SDModel=Llama, Draft Model=1B, Target Model=8B, Operating Point=iso-accuracy2026.04 | 53 | 380 | 1.52 | |
| SMC-SDModel=Llama, Draft Model=1B, Target Model=8B, Operating Point=max speed2026.04 | 53 | 380 | 1.52 | |
| SDModel=Llama, Draft Model=1B, Target Model=8B2026.04 | 52 | 250 | — |