Code Generation on LiveCodeBench (Speedup, Avg Acceptance Length)
3.52SpeedupDEER
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DEERBase Model=Qwen3-30B-A3B, Temperature=0, KV Cache=true2025.12 | 3.52 | 4.62 | |
| DEERBackbone=Qwen3-30B-A3B, temperature=0.6, KV cache=true2025.12 | 3.24 | 4.09 | |
| DEERBase Model=Qwen2-7B, Temperature=0, KV Cache=true2025.12 | 3.06 | 4.96 | |
| DEERBackbone=Qwen2-7B, temperature=0.6, KV cache=true2025.12 | 2.84 | 4.39 | |
| DEERBase Model=Qwen3-14B, Temperature=0, KV Cache=true2025.12 | 2.73 | 4.31 | |
| DEERBase Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 2.67 | 4.63 | |
| DEERBase Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 2.67 | 4.27 | |
| DEERBackbone=Qwen3-14B, temperature=0.6, KV cache=true2025.12 | 2.53 | 3.93 | |
| EAGLE3Base Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 2.46 | 3.38 | |
| EAGLE3Backbone=Qwen2-7B, temperature=0.6, KV cache=true2025.12 | 2.39 | 2.91 | |
| EAGLE3Base Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 2.33 | 3.5 | |
| EAGLE3Base Model=Qwen3-14B, Temperature=0, KV Cache=true2025.12 | 2.3 | 3.48 | |
| EAGLE3Base Model=Qwen2-7B, Temperature=0, KV Cache=true2025.12 | 2.29 | 2.94 | |
| HydraBase Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 2.23 | 2.72 | |
| EAGLE3Base Model=Qwen3-30B-A3B, Temperature=0, KV Cache=true2025.12 | 2.14 | 3.01 | |
| DEERBackbone=Qwen3-4B, temperature=0.6, KV cache=true2025.12 | 2.14 | 4.25 | |
| HydraBase Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 2.08 | 2.54 | |
| EAGLE3Backbone=Qwen3-30B-A3B, temperature=0.6, KV cache=true2025.12 | 1.9 | 2.38 | |
| EAGLE3Backbone=Qwen3-4B, temperature=0.6, KV cache=true2025.12 | 1.79 | 2.51 | |
| EAGLE3Backbone=Qwen3-14B, temperature=0.6, KV cache=true2025.12 | 1.75 | 2.3 | |
| DEERBackbone=Qwen3-8B, temperature=0.6, KV cache=true2025.12 | 1.59 | 2.93 | |
| MEDUSABase Model=Qwen3-8B, Temperature=0, KV Cache=true2025.12 | 1.34 | 1.99 | |
| EAGLE3Backbone=Qwen3-8B, temperature=0.6, KV cache=true2025.12 | 1.33 | 2.42 | |
| MEDUSABase Model=Qwen3-4B, Temperature=0, KV Cache=true2025.12 | 1.17 | 1.89 |