Code Infilling on HumanEval Infilling
57.12Pass@1 MeanA2D2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| A2D2Sampling Steps=10242026.06 | 57.12 | — | — | — | |
| A2D2Sampling Steps=5122026.06 | 53.73 | — | — | — | |
| A2D2Sampling Steps=2562026.06 | 53.44 | — | — | — | |
| LR-DLLMBackbone=DreamCoder-7B2026.02 | 51.3 | 23.2 | 81.6 | 53.8 | |
| A2D2Sampling Steps=1282026.06 | 49.37 | — | — | — | |
| Pre-trained + IFTSampling Steps=10242026.06 | 48.89 | — | — | — | |
| Pre-trained + IFTSampling Steps=5122026.06 | 47.53 | — | — | — | |
| Pre-trained + IFTSampling Steps=2562026.06 | 44.82 | — | — | — | |
| LR-DLLMBackbone=Dream-7B2026.02 | 44.8 | 19.6 | 76.7 | 46.3 | |
| Pre-trained + IFTSampling Steps=1282026.06 | 44.14 | — | — | — | |
| LR-DLLMBackbone=LLaDA-MoE2026.02 | 40.8 | 21.5 | 71.3 | 41.4 | |
| BaselineBackbone=DreamCoder-7B2026.02 | 39.1 | 14.3 | 55.5 | 43.2 | |
| DreamOnBackbone=DreamCoder-7B2026.02 | 37.9 | 21.6 | 73.5 | 36.1 | |
| LR-DLLMBackbone=LLaDA-8B2026.02 | 36.7 | 19.1 | 69.4 | 35.9 | |
| LR-DLLMBackbone=LLaDA-1.52026.02 | 36.1 | 20.5 | 68.9 | 34.6 | |
| BaselineBackbone=LLaDA-MoE2026.02 | 35.1 | 14.6 | 48.8 | 38.4 | |
| BaselineBackbone=LLaDA-1.52026.02 | 31.2 | 16.5 | 48.8 | 32.2 | |
| BaselineBackbone=LLaDA-8B2026.02 | 23.4 | 16 | 48.3 | 21.1 | |
| BaselineBackbone=Dream-7B2026.02 | 22.5 | 8.17 | 48.2 | 21.9 | |
| FlexMDMBackbone=LLaDA-8B2026.02 | — | — | 65 | — |