Chat on Alpaca (SR, τ)
1.79Success Rate (SR)D-PACE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| D-PACEDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 1.79 | 2.54 | |
| D-PACEDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 1.73 | 2.61 | |
| D-PACEDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 1.73 | 2.45 | |
| DFlashDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 1.72 | 2.41 | |
| D-PACEDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 1.71 | 2.56 | |
| DFlashDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 1.68 | 2.49 | |
| DFlashDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 1.67 | 2.32 | |
| Top-3 prefix maskDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 1.62 | 2.29 | |
| DFlashDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 1.62 | 2.39 | |
| Top-3 prefix maskDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 1.6 | 2.25 | |
| Top-3 prefix maskDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 1.58 | 2.34 | |
| Top-3 prefix maskDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 1.51 | 2.23 | |
| Accept-rateDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | 0.8 | 1.04 | |
| Accept-rateDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | 0.79 | 1.04 | |
| Accept-rateDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | 0.74 | 1.01 | |
| Accept-rateDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | 0.74 | 1.01 |