Code Generation on MBPP (Speedup, Average Acceptance Length (τ))
4SpeedupDEER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DEERBase Model=Qwen3-30B-A3B, Temperature=0, KV Cache=true2025.12 | 4 | 4.87 | |
| DEERBase Model=Qwen3-14B, Temperature=0, KV Cache=true2025.12 | 3.18 | 5.28 | |
| DEERBase Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 3 | 5.12 | |
| DEERBase Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 2.86 | 4.91 | |
| EAGLE3Base Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 2.59 | 3.37 | |
| EAGLE3Base Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 2.59 | 3.31 | |
| EAGLE3Base Model=Qwen3-14B, Temperature=0, KV Cache=true2025.12 | 2.5 | 3.52 | |
| DEERBase Model=Qwen2-7B, Temperature=0, KV Cache=true2025.12 | 2.45 | 3.57 | |
| HydraBase Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 2.37 | 2.79 | |
| EAGLE3Base Model=Qwen2-7B, Temperature=0, KV Cache=true2025.12 | 2.36 | 3.32 | |
| HydraBase Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 2.33 | 2.7 | |
| EAGLE3Base Model=Qwen3-30B-A3B, Temperature=0, KV Cache=true2025.12 | 2.22 | 3.07 | |
| MEDUSABase Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 1.29 | 1.93 | |
| MEDUSABase Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 1.2 | 2.07 |