Code Generation on HumanEval-Instruct 0-shot (test)
79.9TPSFast-dLLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Fast-dLLMEvaluation Protocol (Shots)=0-shot, Parallel Decoding=true, Dual-cache KV=true, KV Caching=false2025.11 | 79.9 | 2.5 | 71.6 | 200.9 | 46.3 | |
| Fast-dLLMEvaluation Protocol (Shots)=0-shot, Parallel Decoding=true, Dual-cache KV=false, KV Caching=false2025.11 | 66.4 | 3.2 | 61.6 | 210.2 | 45.7 | |
| CDLM-DreamEvaluation Protocol (Shots)=0-shot, Method=Consistency Diffusion2025.11 | 43.3 | 2.2 | 49.6 | 96.9 | 50 | |
| Dream-7B-InstructEvaluation Protocol (Shots)=0-shot, Parallel Decoding=false, Dual-cache KV=false, KV Caching=false2025.11 | 15.4 | 13.4 | 256 | 206.7 | 48.2 | |
| dLLM-CacheEvaluation Protocol (Shots)=0-shot, Parallel Decoding=false, Dual-cache KV=false, KV Caching=true2025.11 | 9.4 | 12 | 256 | 113.6 | 43.9 |