Code Generation on MBPP C++
89.2Compilation Success RateReprompt
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RepromptModel=DeepSeek-Coder 6.7B2026.05 | 89.2 | 60.7 | 74.1 | |
| VanillaModel=DeepSeek-Coder 6.7B2026.05 | 88.2 | 59.7 | 73 | |
| VanillaModel=CodeLlama 7B2026.05 | 83.9 | 46.1 | 61.7 | |
| RepromptModel=CodeLlama 7B2026.05 | 83.6 | 47.4 | 64.7 | |
| CDCModel=Dream-Coder 7B2026.05 | 72 | 59.2 | 74.8 | |
| CDCModel=Dream 7B2026.05 | 61.2 | 33.8 | 63.7 | |
| VanillaModel=Dream 7B2026.05 | 60.7 | 25.4 | 59.7 | |
| CFG-CDModel=Dream 7B2026.05 | 59.4 | 24.4 | 55.9 | |
| CDCModel=DiffuCoder 7B2026.05 | 56.9 | 41.8 | 68 | |
| VanillaModel=DiffuCoder 7B2026.05 | 53.9 | 28.2 | 53.1 | |
| CFG-CDModel=DiffuCoder 7B2026.05 | 50.6 | 27 | 51.1 | |
| VanillaModel=Dream-Coder 7B2026.05 | 41.1 | 27.7 | 54.2 | |
| CFG-CDModel=Dream-Coder 7B2026.05 | 37.3 | 25.7 | 49.1 |