Code Generation on MBPP 3-shot pass@1 (test)
30.8Pass@1 Accuracy (N=64)SCOPE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SCOPEStrategy=D3IM2026.05 | 30.8 | 36.8 | 36.6 | |
| Original LLaDAStrategy=std unmask2026.05 | 20.4 | 29.4 | 39.2 | |
| SCOPEStrategy=std unmask2026.05 | 16.4 | 27.6 | 36 | |
| Original LLaDAStrategy=D3IM2026.05 | 6.8 | 8.8 | 12 |