Code Infilling on McEval Multi-line
40JavaScript Pass@1Baseline
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BaselineModel=DeepSeek-Coder-6.7B2026.02 | 40 | 32.4 | 33.8 | 33.2 | 47.9 | |
| LR-DLLMModel=DreamCoder-7B2026.02 | 38.8 | 30 | 28 | 21.7 | 51.5 | |
| LR-DLLMModel=Dream-7B2026.02 | 33.8 | 23.3 | 24.4 | 14.1 | 47.9 | |
| LR-DLLMModel=LLaDA-MoE2026.02 | 28.8 | 26.7 | 32.9 | 25 | 51.8 | |
| LR-DLLMModel=LLaDA-8B2026.02 | 27.5 | 22 | 25.6 | 12 | 44.2 | |
| DreamOnModel=DreamCoder-7B2026.02 | 18.8 | 23.3 | 15.9 | 7.6 | 37.2 | |
| BaselineModel=Dream-7B2026.02 | 17.5 | 8.88 | 13.4 | 8.7 | 35.8 | |
| BaselineModel=LLaDA-8B2026.02 | 16.3 | 10 | 23.1 | 7.61 | 37 | |
| BaselineModel=LLaDA-MoE2026.02 | 12.5 | 11.1 | 31.7 | 7.61 | 41 | |
| BaselineModel=DreamCoder-7B2026.02 | 12.5 | 10 | 20.7 | 6.52 | 37.2 |