Code Generation on MBPP (TPS, Speedup, Performance Score)
301.43TPSES-dLLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ES-dLLMBase Model=Dream-7B-Base, Few-shot=32026.03 | 301.43 | 13.3 | 55.2 | |
| DualCacheBase Model=Dream-7B-Base, Few-shot=32026.03 | 216.09 | 9.5 | 56.2 | |
| STDecBase Model=Dream-7B-Instruct, Decoding Strategy=STDec2026.04 | 91.16 | 13.88 | 55.6 | |
| STDecBackbone=LLaDA-8B-Instruct2026.04 | 80.47 | 14.17 | 38.4 | |
| LLaDA Instruct + STDecModel=LLaDA-8B-Instruct2026.04 | 78.32 | 19.2 | 37.2 | |
| LLaDA + LocalLeapBackbone=LLaDA-8B-Instruct2026.04 | 76.48 | 13.46 | 37.6 | |
| LocalLeapBase Model=Dream-7B-Instruct, Decoding Strategy=LocalLeap2026.04 | 63.65 | 9.69 | 53.6 | |
| LLaDA + Fast-dLLM (Parallel)Backbone=LLaDA-8B-Instruct2026.04 | 62.68 | 11.04 | 37.4 | |
| Fast-dLLM (Parallel)Base Model=Dream-7B-Instruct, Decoding Strategy=Fast-dLLM (Parallel)2026.04 | 56.88 | 8.66 | 54.8 | |
| DreamBase Model=Dream-7B-Base, Few-shot=32026.03 | 22.73 | 1 | 55 | |
| Half-StepBase Model=Dream-7B-Instruct, Decoding Strategy=Half-Step2026.04 | 13.11 | 2 | 35.8 | |
| LLaDA + Half-StepBackbone=LLaDA-8B-Instruct2026.04 | 11.51 | 2.02 | 34.8 | |
| dKV-CacheBase Model=Dream-7B-Instruct, Decoding Strategy=dKV-Cache2026.04 | 11.12 | 1.69 | 49.6 | |
| LLaDA + dKV-CacheBackbone=LLaDA-8B-Instruct2026.04 | 10.18 | 1.79 | 39 | |
| Vanilla DreamBase Model=Dream-7B-Instruct, Decoding Strategy=Vanilla2026.04 | 6.57 | 1 | 51.4 | |
| Vanilla LLaDABackbone=LLaDA-8B-Instruct2026.04 | 5.68 | 1 | 37.6 | |
| LLaDA InstructModel=LLaDA-8B-Instruct2026.04 | 4.08 | 1 | 38.2 |