Code Generation on HumanEval 0-shot (TPS, NFE, Acc)
57.93AccuracyVanilla
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VanillaBackbone=Dream-v0-Instruct-7B, Decoding Strategy=Vanilla2026.04 | 57.93 | — | 256 | 4.7 | — | — | — | |
| Fast-dLLMBackbone=Dream-v0-Instruct-7B, Decoding Strategy=Fast-dLLM2026.04 | 57.93 | — | 80.5 | 1.7 | — | — | — | |
| Dream-v0-7B-InstructParallel Decoding=false2026.05 | 56.82 | 14.95 | — | — | — | 1 | — | |
| Fast-dLLMAcceleration Method=Fast-dLLM, Parallel Decoding=true2026.05 | 56.78 | 31.99 | — | — | — | 2.14 | — | |
| Fast-dLLMModel=Dream-v0-Instruct-7B2026.05 | 56.71 | 26.8 | — | — | — | 2.42 | — | |
| BaselineBase Model=Dream-7B-Instruct2026.05 | 56.7 | 3.4 | — | — | 512 | 1 | — | |
| Fast-dLLMAcceleration Method=Fast-dLLM, Parallel Decoding=false2026.05 | 55.7 | 20.18 | — | — | — | 1.35 | — | |
| ConfidenceBackbone=Dream-v0-base-7B, Parallel Decode=Confidence, Block=|B0| = 162026.04 | 55.5 | 38.8 | 137 | — | — | — | — | |
| KLASSBase Model=Dream-7B-Instruct2026.05 | 55.5 | 12.7 | — | — | 94 | 4.9 | — | |
| Dynamic-dLLMAcceleration Method=Dynamic-dLLM, Parallel Decoding=false2026.05 | 54.93 | 27.81 | — | — | — | 1.86 | — | |
| dKV-CacheAcceleration Method=dKV-Cache, Parallel Decoding=false2026.05 | 54.69 | 19.14 | — | — | — | 1.28 | — | |
| dLLM-CacheAcceleration Method=dLLM-Cache, Parallel Decoding=false2026.05 | 54.31 | 24.22 | — | — | — | 1.62 | — | |
| Conf-BasedBase Model=Dream-7B-Instruct2026.05 | 54.3 | 26 | — | — | 65 | 7.5 | — | |
| LEAPBase Model=Dream-7B-Instruct2026.05 | 54.3 | 33.9 | — | — | 50 | 8.8 | — | |
| R²-dLLM (T)Backbone=Dream-v0-Instruct-7B, Decoding Strategy=SFT to reduce redundancy2026.04 | 54.27 | — | 44.6 | 0.9 | — | — | — | |
| KLASSModel=Dream-v0-Instruct-7B2026.05 | 54.27 | 12.8 | — | — | — | 1.16 | — | |
| DAWNModel=Dream-v0-Instruct-7B2026.05 | 54.27 | 31.37 | — | — | — | 2.83 | — | |
| CLADModel=Dream-v0-Instruct-7B2026.05 | 54.27 | 31.62 | — | — | — | 2.86 | — | |
| Dynamic-dLLMAcceleration Method=Dynamic-dLLM, Parallel Decoding=true2026.05 | 54.05 | 36.93 | — | — | — | 2.47 | — | |
| ConfidenceBackbone=Dream-v0-base-7B, Parallel Decode=Confidence, Block=|B0| = 642026.04 | 53.7 | 39.4 | 131.8 | — | — | — | — | |
| AdaBlockBackbone=Dream-v0-base-7B, Parallel Decode=Confidence, Block=AdaBlock2026.04 | 53.7 | 38.6 | 137.9 | — | — | — | — | |
| LocalLeapBackbone=Dream-v0-Instruct-7B, Decoding Strategy=LocalLeap2026.04 | 53.66 | — | 75 | 1.4 | — | — | — | |
| dParallelBackbone=Dream-v0-Instruct-7B, Decoding Strategy=dParallel2026.04 | 53.66 | — | 50.4 | 1.1 | — | — | — | |
| R²-dLLM (F)Backbone=Dream-v0-Instruct-7B, Decoding Strategy=training-free redundancy reduction2026.04 | 53.05 | — | 67.5 | 1.3 | — | — | — | |
| ConfidenceBackbone=Dream-v0-base-7B, Parallel Decode=Confidence, Block=|B0| = 322026.04 | 53 | 39 | 135.3 | — | — | — | — | |
| VanillaModel=Dream-v0-Instruct-7B2026.05 | 52.44 | 11.07 | — | — | — | 1 | — | |
| LoPABase Model=Dream-7B-Instruct2026.05 | 52.4 | 12.4 | — | — | 76 | 4 | — | |
| DAPDModel=Dream-v0-Instruct-7B2026.05 | 51.83 | 12.28 | — | — | — | 1.11 | — | |
| DepGA-BlockBackbone=Dream-v0-base-7B, Parallel Decode=Confidence, Block=DepGA-Block2026.04 | 50.6 | 39.5 | 132.5 | — | — | — | — | |
| CAP-DecodingBackbone=Dream-v0-base-7B, Parallel Decode=CAP-Decoding, Block=|B0| = 322026.04 | 50.6 | 39.8 | 127.3 | — | — | — | — | |
| DepCapBackbone=Dream-v0-base-7B, Parallel Decode=CAP-Decoding, Block=DepGA-Block2026.04 | 50.6 | 40.6 | 125.3 | — | — | — | — | |
| VanillaBackbone=Dream-v0-base-7B, Parallel Decode=Vanilla, Block=|B0| = 322026.04 | 49.4 | 20.7 | 256 | — | — | — | — | |
| d3LLM-TF-LLaDABlock size=5122026.06 | 44.51 | 92.52 | — | — | — | — | — | |
| KLASSBackbone Model=Dream-v0-Base-7B, Shot Setting=0-shot2026.05 | 43.9 | 16.98 | — | — | — | 1.05 | — | |
| ConfidenceBackbone=LLaDA-8B-Instruct, Parallel Decode=Confidence, Block=|B0| = 162026.04 | 43.3 | 51 | 86.4 | — | — | — | — | |
| ConfidenceBackbone=LLaDA-8B-Instruct, Parallel Decode=Confidence, Block=|B0| = 322026.04 | 43.3 | 56.5 | 77.5 | — | — | — | — | |
| CAP-DecodingBackbone=LLaDA-8B-Instruct, Parallel Decode=CAP-Decoding, Block=|B0| = 322026.04 | 43.3 | 60.4 | 72 | — | — | — | — | |
| Fast-dLLMBackbone Model=Dream-v0-Base-7B, Shot Setting=0-shot2026.05 | 43.29 | 30.18 | — | — | — | 1.87 | — | |
| VanillaBackbone=LLaDA-8B-Instruct, Parallel Decode=Vanilla, Block=|B0| = 322026.04 | 42.7 | 16.7 | 256 | — | — | — | — | |
| DepGA-BlockBackbone=LLaDA-8B-Instruct, Parallel Decode=Confidence, Block=DepGA-Block2026.04 | 42.7 | 53.4 | 80.6 | — | — | — | — | |
| DepCapBackbone=LLaDA-8B-Instruct, Parallel Decode=CAP-Decoding, Block=DepGA-Block2026.04 | 42.7 | 59.8 | 74.8 | — | — | — | — | |
| KLASSBase Model=LLaDA-8B-Instruct2026.05 | 42.7 | 20.1 | — | — | 219 | 1.9 | — | |
| LEAPBase Model=LLaDA-8B-Instruct2026.05 | 42.7 | 36.5 | — | — | 125 | 3.3 | — | |
| VanillaBackbone Model=LLaDA-1.5, Shot Setting=0-shot2026.05 | 42.68 | 5.77 | — | — | — | 1 | — | |
| Fast-dLLMBackbone Model=LLaDA-1.5, Shot Setting=0-shot2026.05 | 42.68 | 15 | — | — | — | 2.6 | — | |
| KLASSBackbone Model=LLaDA-1.5, Shot Setting=0-shot2026.05 | 42.68 | 5.46 | — | — | — | 0.95 | — | |
| CLADBackbone Model=LLaDA-1.5, Shot Setting=0-shot2026.05 | 42.68 | 20.71 | — | — | — | 3.59 | — | |
| DAWNBackbone Model=Dream-v0-Base-7B, Shot Setting=0-shot2026.05 | 42.68 | 33.68 | — | — | — | 2.09 | — | |
| BaselineBase Model=LLaDA-8B-Instruct2026.05 | 42.3 | 10.8 | — | — | 512 | 1 | — | |
| ConfidenceBackbone=LLaDA-1.5, Parallel Decode=Confidence, Block=|B0| = 642026.04 | 42.1 | 16.1 | 93.4 | — | — | — | — | |
| CAP-DecodingBackbone=LLaDA-1.5, Parallel Decode=CAP-Decoding, Block=|B0| = 322026.04 | 42.1 | 16.4 | 93 | — | — | — | — | |
| Conf-BasedBase Model=LLaDA-8B-Instruct2026.05 | 42.1 | 30.2 | — | — | 176 | 2.8 | — | |
| FactorGen. Len.=512, Backbone=LLaDA-8B-Instruct2026.06 | 41.7 | 70.3 | 20,463 | — | — | — | 3.75 | |
| ConfidenceBackbone=LLaDA-8B-Instruct, Parallel Decode=Confidence, Block=|B0| = 642026.04 | 41.5 | 57.2 | 76.4 | — | — | — | — | |
| VanillaBackbone=LLaDA-1.5, Parallel Decode=Vanilla, Block=|B0| = 322026.04 | 41.5 | 5.9 | 256 | — | — | — | — | |
| DepCapBackbone=LLaDA-1.5, Parallel Decode=CAP-Decoding, Block=DepGA-Block2026.04 | 41.5 | 16.2 | 98.5 | — | — | — | — | |
| ThresholdGen. Len.=512, Backbone=LLaDA-8B-Instruct, Threshold=τ = 0.92026.06 | 41.5 | 54.1 | 27,366 | — | — | — | 2.8 | |
| Fréchet profile decodingGen. Len.=512, Backbone=LLaDA-8B-Instruct, Margin=δ = 0.252026.06 | 41.5 | 75.5 | 18,909 | — | — | — | 4.05 | |
| Fast-dLLMModel=LLaDA-8B-Instruct2026.05 | 41.46 | 55.11 | — | — | — | 3.31 | — | |
| DAPDBackbone Model=LLaDA-1.5, Shot Setting=0-shot2026.05 | 41.46 | 10.83 | — | — | — | 1.88 | — | |
| DAWNBackbone Model=LLaDA-1.5, Shot Setting=0-shot2026.05 | 41.46 | 19.15 | — | — | — | 3.32 | — | |
| AdaBlockBackbone=LLaDA-8B-Instruct, Parallel Decode=Confidence, Block=AdaBlock2026.04 | 40.9 | 50.4 | 86.2 | — | — | — | — | |
| ConfidenceBackbone=LLaDA-1.5, Parallel Decode=Confidence, Block=|B0| = 162026.04 | 40.9 | 14.2 | 106.9 | — | — | — | — | |
| Fréchet profile decodingGen. Len.=256, Backbone=LLaDA-8B-Instruct, Margin=δ = 0.252026.06 | 40.9 | 107.7 | 9,740 | — | — | — | 4.06 | |
| FactorGen. Len.=256, Backbone=LLaDA-8B-Instruct2026.06 | 40.7 | 89.6 | 10,538 | — | — | — | 3.78 | |
| VanillaBackbone=LLaDA-Instruct-8B, Decoding Strategy=Vanilla2026.04 | 40.24 | — | 256 | 5.8 | — | — | — | |
| VanillaModel=LLaDA-8B-Instruct2026.05 | 40.24 | 16.66 | — | — | — | 1 | — | |
| KLASSModel=LLaDA-8B-Instruct2026.05 | 40.24 | 31.81 | — | — | — | 1.91 | — | |
| DAWNModel=LLaDA-8B-Instruct2026.05 | 40.24 | 67.99 | — | — | — | 4.08 | — | |
| CLADModel=LLaDA-8B-Instruct2026.05 | 40.24 | 70.65 | — | — | — | 4.24 | — | |
| d3LLM-TF-LLaDABlock size=10242026.06 | 40.24 | 71.72 | — | — | — | — | — | |
| ConfidenceBackbone=LLaDA-1.5, Parallel Decode=Confidence, Block=|B0| = 322026.04 | 40.2 | 15.3 | 99.6 | — | — | — | — | |
| ThresholdGen. Len.=256, Backbone=LLaDA-8B-Instruct, Threshold=τ = 0.92026.06 | 40.2 | 77.8 | 13,666 | — | — | — | 2.87 | |
| DAPDModel=LLaDA-8B-Instruct2026.05 | 39.63 | 32.51 | — | — | — | 1.95 | — | |
| DAPDBackbone Model=Dream-v0-Base-7B, Shot Setting=0-shot2026.05 | 39.63 | 24.73 | — | — | — | 1.54 | — | |
| CLADBackbone Model=Dream-v0-Base-7B, Shot Setting=0-shot2026.05 | 39.63 | 33.31 | — | — | — | 2.07 | — | |
| DepGA-BlockBackbone=LLaDA-1.5, Parallel Decode=Confidence, Block=DepGA-Block2026.04 | 39.6 | 14.8 | 105.6 | — | — | — | — | |
| VanillaBackbone Model=Dream-v0-Base-7B, Shot Setting=0-shot2026.05 | 39.02 | 16.1 | — | — | — | 1 | — | |
| d3LLM-TF-LLaDABlock size=2562026.06 | 39.02 | 112.61 | — | — | — | — | — | |
| AsyncLane-LLaDABlock size=2562026.06 | 38.47 | 140.58 | — | — | — | — | — | |
| AsyncLane-LLaDABlock size=10242026.06 | 38.22 | 138.58 | — | — | — | — | — | |
| AdaBlockBackbone=LLaDA-1.5, Parallel Decode=Confidence, Block=AdaBlock2026.04 | 37.8 | 14.1 | 110.9 | — | — | — | — | |
| ThresholdModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=2562026.06 | 37.8 | 53.7 | 25,465 | — | — | — | 1.64 | |
| ThresholdModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=5122026.06 | 37.8 | 58.7 | 44,862 | — | — | — | 1.87 | |
| Fast-dLLM-LLaDABlock size=2562026.06 | 37.8 | 60.84 | — | — | — | — | — | |
| AsyncLane-LLaDABlock size=5122026.06 | 37.8 | 137.88 | — | — | — | — | — | |
| Fast-dLLM-LLaDABlock size=5122026.06 | 37.46 | 35.88 | — | — | — | — | — | |
| Fast-dLLM-LLaDABlock size=10242026.06 | 37.37 | 11.28 | — | — | — | — | — | |
| FrechetModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=5122026.06 | 37.2 | 72.7 | 37,168 | — | — | — | 2.25 | |
| LLaDABlock size=2562026.06 | 37.19 | 13.52 | — | — | — | — | — | |
| FactorModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=5122026.06 | 36.6 | 71 | 37,740 | — | — | — | 2.22 | |
| Fast-dLLMBackbone=LLaDA-Instruct-8B, Decoding Strategy=Fast-dLLM2026.04 | 36.59 | — | 90.1 | 2.5 | — | — | — | |
| R²-dLLM (T)Backbone=LLaDA-Instruct-8B, Decoding Strategy=SFT to reduce redundancy2026.04 | 36.59 | — | 64.3 | 1.7 | — | — | — | |
| LLaDABlock size=10242026.06 | 36.01 | 1.19 | — | — | — | — | — | |
| FactorModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=2562026.06 | 36 | 68.3 | 20,246 | — | — | — | 2 | |
| LocalLeapBackbone=LLaDA-Instruct-8B, Decoding Strategy=LocalLeap2026.04 | 35.98 | — | 69.8 | 2.1 | — | — | — | |
| R²-dLLM (F)Backbone=LLaDA-Instruct-8B, Decoding Strategy=training-free redundancy reduction2026.04 | 35.98 | — | 81.7 | 2.3 | — | — | — | |
| LLaDABlock size=5122026.06 | 35.98 | 6.04 | — | — | — | — | — | |
| FrechetModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=2562026.06 | 35.4 | 70.6 | 20,156 | — | — | — | 2.14 | |
| dParallelBackbone=LLaDA-Instruct-8B, Decoding Strategy=dParallel2026.04 | 33.53 | — | 37.9 | 1.1 | — | — | — |