Code Generation on MBPP (Accuracy, TPF, TPS, Speedup)
284TPFJacobi Forcing Model (MR)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Jacobi Forcing Model (MR)Family=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct, Multi-block and rejection-recycling=true2025.12 | 284 | 113 | 2.62 | 70.4 | |
| Jacobi Forcing ModelFamily=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct2025.12 | 274 | 110.7 | 2.57 | 70.4 | |
| D2FFamily=Diffusion-based, Backbone=Dream-7B2025.12 | 230 | 105 | 2.44 | 55.2 | |
| CLLM*Family=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct, sequence packing=new sequence packing technique2025.12 | 210 | 80.1 | 1.94 | 71.4 | |
| Fast-dLLM (DC)Family=Diffusion-based, Backbone=Dream-7B, bi-directional dual cache=true2025.12 | 190 | 73.2 | 1.7 | 51 | |
| JacobiFamily=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct2025.12 | 101 | 42.4 | 0.98 | 74.3 | |
| ARFamily=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct2025.12 | 100 | 43.1 | 1 | 74.3 | |
| LLaDA-InstructFamily=Diffusion-based, Backbone=LLaDA-7B2025.12 | 100 | 0.9 | 0.02 | 39 | |
| Dream-BaseFamily=Diffusion-based, Backbone=Dream-7B2025.12 | 100 | 10.4 | 0.24 | 56.2 |