Code Generation on MBPP (SR, τ)
3.53Success Rate (SR)D-PACE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| D-PACEDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 3.53 | 4.99 | |
| D-PACEDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 3.47 | 4.68 | |
| D-PACEDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 3.33 | 4.73 | |
| D-PACEDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 3.26 | 4.38 | |
| DFlashDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 3.24 | 4.56 | |
| DFlashDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 3.2 | 4.31 | |
| DFlashDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 3.08 | 4.32 | |
| Top-3 prefix maskDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 3.06 | 4.13 | |
| Top-3 prefix maskDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 3.06 | 4.31 | |
| DFlashDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 3.04 | 4.11 | |
| Top-3 prefix maskDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 2.88 | 3.88 | |
| Top-3 prefix maskDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 2.86 | 4.01 | |
| Accept-rateDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 0.79 | 1.03 | |
| Accept-rateDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 0.78 | 1.03 | |
| Accept-rateDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 0.74 | 1.02 | |
| Accept-rateDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 0.74 | 1.02 |