Code Generation on HumanEval (SR, τ)
3.81SRD-PACE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| D-PACEDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 3.81 | 5.54 | |
| D-PACEDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 3.71 | 5.12 | |
| D-PACEDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 3.58 | 5.19 | |
| D-PACEDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 3.48 | 4.83 | |
| DFlashDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 3.45 | 4.98 | |
| DFlashDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 3.38 | 4.66 | |
| Top-3 prefix maskDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 3.27 | 4.73 | |
| DFlashDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 3.25 | 4.71 | |
| Top-3 prefix maskDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 3.22 | 4.43 | |
| DFlashDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 3.16 | 4.37 | |
| Top-3 prefix maskDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 3.06 | 4.43 | |
| Top-3 prefix maskDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 3.04 | 4.19 | |
| Accept-rateDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 0.77 | 1.03 | |
| Accept-rateDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 0.77 | 1.04 | |
| Accept-rateDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 0.73 | 1.02 | |
| Accept-rateDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 0.73 | 1.02 |