Code Generation on MBPP 3-shot (test)
64.1Speedup RatioStreaming-dLLM
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Streaming-dLLMGen Length=512, Evaluation Protocol=3-shot2026.01 | 64.1 | — | — | 40.8 | 1.1 | — | — | |
| d2CacheModel=LLaDA-Inst, Few-shot=3-shot, Gen. Len.=512, Decoding Strategy=Semi-AR parallel decoding2025.09 | 48.3 | — | — | — | 4.64 | 119.81 | 40.2 | |
| d2CacheModel=Dream-Inst, Few-shot=3-shot, Gen. Len.=512, Decoding Strategy=Semi-AR parallel decoding2025.09 | 39.7 | — | — | — | 5.11 | 108.39 | 52.8 | |
| Streaming-dLLMGen Length=256, Evaluation Protocol=3-shot2026.01 | 32.7 | — | — | 42 | 0.9 | — | — | |
| TSPDBackbone=LLaDA-8B-Instruct, KV Cache=true, Generation Length=2562026.05 | 11.8 | — | — | 29.2 | — | 68.4 | — | |
| Fast-dLLMGen Length=512, Evaluation Protocol=3-shot2026.01 | 9.3 | — | — | 13.8 | 7.6 | — | — | |
| Fast-dLLMGen Length=256, Evaluation Protocol=3-shot2026.01 | 7.7 | — | — | 28.2 | 3.8 | — | — | |
| Fast-dLLMBackbone=LLaDA-8B-Instruct, KV Cache=true, Generation Length=2562026.05 | 7.2 | — | — | 28.2 | — | 41.8 | — | |
| Credit DecodingBackbone=LLaDA-8B-Instruct, KV Cache=true, Generation Length=2562026.05 | 7 | — | — | 29.3 | — | 40.6 | — | |
| TSPDBackbone=LLaDA-8B-Instruct, KV Cache=false, Generation Length=2562026.05 | 5.6 | — | — | 29.5 | — | 32.5 | — | |
| Learn2PDBackbone=LLaDA-8B-Instruct, KV Cache=false, Generation Length=2562026.05 | 5.1 | — | — | 29.2 | — | 29.6 | — | |
| Prefix-CacheGen Length=256, Evaluation Protocol=3-shot2026.01 | 3.4 | — | — | 29.6 | 8.6 | — | — | |
| Prefix-CacheGen Length=512, Evaluation Protocol=3-shot2026.01 | 3 | — | — | 13.4 | 23.6 | — | — | |
| dKV-CacheGen Length=256, Evaluation Protocol=3-shot2026.01 | 1.7 | — | — | 26.2 | 17.6 | — | — | |
| dKV-CacheGen Length=512, Evaluation Protocol=3-shot2026.01 | 1.6 | — | — | 14.6 | 43.3 | — | — | |
| ProphetBackbone=LLaDA-8B-Instruct, KV Cache=false, Generation Length=2562026.05 | 1.4 | — | — | 29.2 | — | 8.1 | — | |
| LLaDAGen Length=256, Evaluation Protocol=3-shot2026.01 | 1 | — | — | 29.4 | 29.4 | — | — | |
| LLaDAGen Length=512, Evaluation Protocol=3-shot2026.01 | 1 | — | — | 14.8 | 70.5 | — | — | |
| VanillaBackbone=LLaDA-8B-Instruct, KV Cache=true, Generation Length=2562026.05 | 1 | — | — | 29.4 | — | 5.8 | — | |
| diffu-GRPO(d1)Sequence Length=128, Few-shot=32025.12 | — | 34.8 | — | — | — | — | — | |
| diffu-GRPO(d1)Sequence Length=256, Few-shot=32025.12 | — | 36.6 | — | — | — | — | — | |
| diffu-GRPO(d1)Sequence Length=512, Few-shot=32025.12 | — | 38 | — | — | — | — | — | |
| diffu-GRPO(d1)Few-shot=32025.12 | — | — | 36.5 | — | — | — | — | |
| DualCacheBackbone=LLaDA-8B-Base, Speedup=12.6×2026.03 | — | 38.6 | — | — | — | 120.12 | — | |
| ES-dLLMBackbone=LLaDA-8B-Base, Speedup=16.7×2026.03 | — | 38 | — | — | — | 158.81 | — | |
| ESPOSequence Length=128, Few-shot=32025.12 | — | 47.4 | — | — | — | — | — | |
| ESPOSequence Length=256, Few-shot=32025.12 | — | 44.6 | — | — | — | — | — | |
| ESPOSequence Length=512, Few-shot=32025.12 | — | 44.2 | — | — | — | — | — | |
| ESPOFew-shot=32025.12 | — | — | 45.4 | — | — | — | — | |
| LLaDASequence Length=128, Few-shot=32025.12 | — | 38.2 | — | — | — | — | — | |
| LLaDASequence Length=256, Few-shot=32025.12 | — | 37 | — | — | — | — | — | |
| LLaDASequence Length=512, Few-shot=32025.12 | — | 38.2 | — | — | — | — | — | |
| LLaDAFew-shot=32025.12 | — | — | 37.8 | — | — | — | — | |
| LLaDABackbone=LLaDA-8B-Base, Speedup=1.0×2026.03 | — | 39.6 | — | — | — | 9.53 | — | |
| LLaDA-1.5Sequence Length=128, Few-shot=32025.12 | — | 39.6 | — | — | — | — | — | |
| LLaDA-1.5Sequence Length=256, Few-shot=32025.12 | — | 39.9 | — | — | — | — | — | |
| LLaDA-1.5Sequence Length=512, Few-shot=32025.12 | — | 38.8 | — | — | — | — | — | |
| LLaDA-1.5Few-shot=32025.12 | — | — | 39.4 | — | — | — | — | |
| wd1Sequence Length=128, Few-shot=32025.12 | — | 38 | — | — | — | — | — | |
| wd1Sequence Length=256, Few-shot=32025.12 | — | 37.2 | — | — | — | — | — | |
| wd1Sequence Length=512, Few-shot=32025.12 | — | 34.4 | — | — | — | — | — | |
| wd1Few-shot=32025.12 | — | — | 36.5 | — | — | — | — |