Code Generation on MBPP-plus (pass@1, pass@5)
48.7Pass@1LLaDA-8B-Ins
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LLaDA-8B-InsAvg. NFE=2562026.01 | 48.7 | 68.8 | |
| CADAvg. NFE=108, Speedup=3.51x2026.01 | 47.9 | — | |
| CADAvg. NFE=108.8, Speedup=3.41x2026.01 | — | 67.7 |
Loading the SOTA2 catalog…