Code Generation on DMC
73.4PASS@1CWM RL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CWM RLPublic pass=true2026.03 | 73.4 | — | 87.6 | — | |
| Execution RLEFfeedback=Oracle2026.03 | 65.3 | 77.6 | 80.6 | 86.1 | |
| Self-RLEF2026.03 | 63.2 | 76.8 | 80.2 | 82.5 | |
| CWM RL2026.03 | 60.8 | 72.8 | 76 | 74.7 | |
| QWEN3-32BPublic pass=true2026.03 | 56.3 | — | 79 | — | |
| QWEN2.5-7B RLPublic pass=true2026.03 | 55.1 | — | 76.5 | — | |
| CWMversion=Official2026.03 | 49 | 63.7 | 67.9 | 60.8 | |
| QWEN3-4BPublic pass=true2026.03 | 42.5 | — | 65.4 | — |