Code Generation on HumanEval (Speedup)
4.06SpeedupFailFast
Evaluation results
| Method | Links | |
|---|---|---|
| FailFastTarget Model=Qwen2.5-32B-Instruct2025.12 | 4.06 | |
| FailFastTarget Model=Qwen2.5-14B-Instruct2025.12 | 3.41 | |
| EAGLE-3 (w/ draft tree)Target Model=Qwen2.5-32B-Instruct2025.12 | 3.31 | |
| Fast-dLLMTarget Model=Qwen2.5-32B-Instruct2025.12 | 3.16 | |
| AR Draft ModelTarget Model=Qwen2.5-32B-Instruct2025.12 | 2.72 | |
| FailFastTarget Model=Qwen2.5-7B-Instruct2025.12 | 2.71 | |
| EAGLE-3 (w/ draft tree)Target Model=Qwen2.5-14B-Instruct2025.12 | 2.68 | |
| EAGLE-3 (w/ draft tree)Target Model=Qwen2.5-7B-Instruct2025.12 | 2.39 | |
| Fast-dLLMTarget Model=Qwen2.5-14B-Instruct2025.12 | 2.23 | |
| AR Draft ModelTarget Model=Qwen2.5-14B-Instruct2025.12 | 1.91 | |
| Fast-dLLMTarget Model=Qwen2.5-7B-Instruct2025.12 | 1.61 | |
| AR Draft ModelTarget Model=Qwen2.5-7B-Instruct2025.12 | 1.4 |