Code Generation on HumanEval (Speed, tau, Score)
4.15Inference Speed (× Baseline)CoSpec
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CoSpecSetting=T = 1, Target=LLaMA-70B2026.05 | 4.15 | 21.32 | 87.4 | |
| CoSpecSetting=T = 0, Target=LLaMA-70B2026.05 | 4.13 | 21.18 | 87.2 | |
| EAGLE-3Setting=T = 0, Target=LLaMA-70B2026.05 | 3.94 | 5.73 | 85.37 | |
| EAGLE-3Setting=T = 1, Target=LLaMA-70B2026.05 | 3.74 | 5.4 | 85.41 | |
| FLySetting=T = 0, Target=LLaMA-70B2026.05 | 2.75 | 12.2 | 84.54 | |
| FLySetting=T = 1, Target=LLaMA-70B2026.05 | 2.75 | 12.55 | 84.69 | |
| CoSpecSetting=T = 0, Target=Qwen3-32B2026.05 | 2.15 | 18.71 | 92.14 | |
| CoSpecSetting=T = 1, Target=Qwen3-32B2026.05 | 2.03 | 18.58 | 92.42 | |
| EAGLE-3Setting=T = 0, Target=Qwen3-32B2026.05 | 1.98 | 4.13 | 89.63 | |
| RESTSetting=T = 0, Target=LLaMA-70B2026.05 | 1.88 | 2.22 | 85.37 | |
| RESTSetting=T = 1, Target=LLaMA-70B2026.05 | 1.81 | 2.13 | 85.41 | |
| EAGLE-3Setting=T = 1, Target=Qwen3-32B2026.05 | 1.81 | 4.05 | 89.69 | |
| FLySetting=T = 0, Target=Qwen3-32B2026.05 | 1.69 | 10.3 | 89.04 | |
| FLySetting=T = 1, Target=Qwen3-32B2026.05 | 1.66 | 10.05 | 89.12 | |
| AASDSetting=T = 1, Target=LLaMA-70B2026.05 | 1.65 | 1.95 | 85.98 | |
| AASDSetting=T = 0, Target=LLaMA-70B2026.05 | 1.62 | 1.9 | 85.98 | |
| SpSSetting=T = 0, Target=LLaMA-70B2026.05 | 1.61 | 9.87 | 85.37 | |
| AASDSetting=T = 0, Target=Qwen3-32B2026.05 | 1.54 | 1.89 | 89.55 | |
| AASDSetting=T = 1, Target=Qwen3-32B2026.05 | 1.52 | 1.87 | 89.62 | |
| SpSSetting=T = 1, Target=LLaMA-70B2026.05 | 1.47 | 6.29 | 85.41 | |
| SpSSetting=T = 0, Target=Qwen3-32B2026.05 | 1.29 | 8.44 | 89.63 | |
| SpSSetting=T = 1, Target=Qwen3-32B2026.05 | 1.22 | 8.27 | 89.69 | |
| Target onlySetting=T = 0, Target=LLaMA-70B2026.05 | 1 | 1 | 85.37 | |
| Target onlySetting=T = 0, Target=Qwen3-32B2026.05 | 1 | 1 | 89.63 | |
| Target onlySetting=T = 1, Target=LLaMA-70B2026.05 | 1 | 1 | 85.41 | |
| Target onlySetting=T = 1, Target=Qwen3-32B2026.05 | 1 | 1 | 89.69 |