Code Generation on MBPP (Decode speed)
1.753Decode Speed (tokens/s)Lever
Evaluation results
| Method | Links | |
|---|---|---|
| LeverTarget Model=Qwen3-8B, Draft Model=EAGLE32026.05 | 1.753 | |
| EdgeLLMTarget Model=Qwen3-8B, Draft Model=EAGLE32026.05 | 1.434 | |
| Chain-SDTarget Model=Qwen3-8B, Draft Model=EAGLE32026.05 | 1.296 | |
| LeverTarget Model=Qwen3-8B, Draft Model=Qwen3 (0.6B)2026.05 | 1.25 | |
| EdgeLLMTarget Model=Qwen3-8B, Draft Model=Qwen3 (0.6B)2026.05 | 1.01 | |
| Chain-SDTarget Model=Qwen3-8B, Draft Model=Qwen3 (0.6B)2026.05 | 0.86 |