Coding Reasoning on CodeMMLU
82.8Pass@4MPD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MPD2026.05 | 82.8 | 2,300 | |
| CRISP2026.05 | 82.7 | 4,100 | |
| LiteCoT2026.05 | 82.1 | 3,400 | |
| Direct Comp.2026.05 | 82 | 2,400 | |
| Vanilla LLM2026.05 | 81.2 | 3,600 | |
| Chain-of-Draft2026.05 | 79 | 2,000 |
| Method | Links | ||
|---|---|---|---|
| MPD2026.05 | 82.8 | 2,300 | |
| CRISP2026.05 | 82.7 | 4,100 | |
| LiteCoT2026.05 | 82.1 | 3,400 | |
| Direct Comp.2026.05 | 82 | 2,400 | |
| Vanilla LLM2026.05 | 81.2 | 3,600 | |
| Chain-of-Draft2026.05 | 79 | 2,000 |