Code Generation on MBPP (MBPP, MBPP+)
83.6MBPPStable-DiffCoder-8B-Base
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Stable-DiffCoder-8B-BaseType=DLLM, Size=8B2026.01 | 83.6 | 67.7 | |
| Qwen2.5-Coder-14BType=AR, Size=14B2026.01 | 83.6 | 69.8 | |
| Seed-Coder-8B-BaseType=AR, Size=8B2026.01 | 82 | 69 | |
| Llama-3.1-70B-BaseType=AR, Size=70B2026.01 | 81.4 | 67.2 | |
| OpenCoder-8B-BaseType=AR, Size=8B2026.01 | 79.9 | 70.4 | |
| Qwen2.5-Coder-7BType=AR, Size=7B2026.01 | 79.4 | 68.3 | |
| Dream-Coder-7B-BaseType=DLLM, Size=7B2026.01 | 75.9 | 61.6 | |
| DiffuCoder-7B-BaseType=DLLM, Size=7B2026.01 | 74.2 | 60.9 | |
| DeepSeek-Coder-33B-BaseType=AR, Size=33B2026.01 | 74.2 | 60.7 | |
| CodeQwen1.5-7BType=AR, Size=7B2026.01 | 72.2 | 60.2 | |
| DeepSeek-Coder-V2-Lite-BaseType=AR, Size=2.4B/16B2026.01 | 71.9 | 59.4 | |
| CodeLlama-70B-BaseType=AR, Size=70B2026.01 | 71 | 65.6 | |
| DeepSeek-Coder-6.7B-BaseType=AR, Size=6.7B2026.01 | 70.2 | 56.6 | |
| Dream-7B-BaseType=DLLM, Size=7B2026.01 | 68.7 | 57.4 | |
| WeDLM-8B-BaseType=DLLM, Size=8B2026.01 | 67 | — | |
| StarCoder2-15BType=AR, Size=15B2026.01 | 66.2 | 53.1 | |
| StarCoder2-7BType=AR, Size=7B2026.01 | 54.4 | 45.6 | |
| LLaDA-MoE-7B-A1B-BaseType=DLLM, Size=1B/7B2026.01 | 52.4 | — | |
| LLaDA-8B-BaseType=DLLM, Size=8B2026.01 | 50.1 | 42.1 |