Code Generation on MBPP-Instruct 0-shot (test)
60.6TPSCDLM-LLaDA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CDLM-LLaDAShots=0-shot2025.11 | 60.6 | 3.2 | 58 | 195.3 | 38.4 | |
| CDLM-DreamEvaluation Protocol (Shots)=0-shot, Method=Consistency Diffusion2025.11 | 48.1 | 1.5 | 33.2 | 74.3 | 53 | |
| Fast-dLLM (Par.+D.C.)Shots=0-shot, parallel decoding=true, dual-cache KV=true2025.11 | 40.1 | 3.4 | 66.9 | 134.7 | 35 | |
| Fast-dLLMEvaluation Protocol (Shots)=0-shot, Parallel Decoding=true, Dual-cache KV=true, KV Caching=false2025.11 | 25.4 | 1.9 | 43.6 | 47.1 | 53.4 | |
| Fast-dLLM (Par.)Shots=0-shot, parallel decoding=true2025.11 | 21.2 | 6.2 | 59.1 | 131.8 | 42 | |
| dLLM-CacheShots=0-shot, cache_mode=dLLM-Cache2025.11 | 18.5 | 10.8 | 256 | 199.4 | 40.8 | |
| LLaDA-8B-InstructShots=0-shot2025.11 | 17.7 | 11.4 | 256 | 201 | 40.8 | |
| Fast-dLLMEvaluation Protocol (Shots)=0-shot, Parallel Decoding=true, Dual-cache KV=false, KV Caching=false2025.11 | 15.5 | 3.1 | 35.3 | 47.3 | 55.6 | |
| dLLM-CacheEvaluation Protocol (Shots)=0-shot, Parallel Decoding=false, Dual-cache KV=false, KV Caching=true2025.11 | 5.1 | 11.3 | 256 | 57.3 | 56 | |
| Dream-7B-InstructEvaluation Protocol (Shots)=0-shot, Parallel Decoding=false, Dual-cache KV=false, KV Caching=false2025.11 | 2.3 | 21.7 | 256 | 49.5 | 51.8 |