Code Generation on HumanEval (Speedup, τ Length)
2.74SpeedupHyperDFlash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HyperDFlashTemperature=0, Number of drafted steps=6, Mode=Non-thinking2026.06 | 2.74 | 4.29 | |
| HyperDFlashTemperature=1, Number of drafted steps=6, Mode=Non-thinking2026.06 | 2.67 | 4.17 | |
| MTPTemperature=0, Number of drafted steps=3, Mode=Non-thinking2026.06 | 2.1 | 3.06 | |
| MTPTemperature=1, Number of drafted steps=3, Mode=Non-thinking2026.06 | 2.06 | 2.95 | |
| Vanilla DFlashTemperature=0, Number of drafted steps=6, Mode=Non-thinking2026.06 | 1.69 | 2.24 | |
| Vanilla DFlashTemperature=1, Number of drafted steps=6, Mode=Non-thinking2026.06 | 1.66 | 2.21 | |
| MTPTemperature=0, Number of drafted steps=6, Mode=Non-thinking2026.06 | 1.63 | 3.2 | |
| MTPTemperature=1, Number of drafted steps=6, Mode=Non-thinking2026.06 | 1.58 | 3.08 |