Software Engineering Efficiency on SWE-bench Lite (Speedup, Mean acceptance length (τ))
4.66SpeedupDraft-OPD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Draft-OPDModel=Q3-4B, Thinking Mode=Enabled, Temperature=02026.05 | 4.66 | 5.96 | |
| DFlash+DDTreeModel=Qwen3-Coder-30B-A3B-Instruct, Temperature=0.0, Node Budget=Best from {16, 32, 64, 128, 256, 512, 1024}2026.04 | 4.38 | 5.71 | |
| Draft-OPDModel=Q3-8B, Thinking Mode=Enabled, Temperature=02026.05 | 4.31 | 5.73 | |
| DFlash+DDTreeModel=Qwen3-4B, Temperature=0.0, Node Budget=Best from {16, 32, 64, 128, 256, 512, 1024}2026.04 | 4.25 | 5.99 | |
| DFlash+DDTreeModel=Qwen3-8B, Temperature=0.0, Node Budget=Best from {16, 32, 64, 128, 256, 512, 1024}2026.04 | 4.23 | 5.91 | |
| DFlashModel=Q3-4B, Thinking Mode=Enabled, Temperature=02026.05 | 4.12 | 5.51 | |
| DFlash+DDTreeModel=Qwen3-Coder-30B-A3B-Instruct, Temperature=1.0, Node Budget=Best from {16, 32, 64, 128, 256, 512, 1024}2026.04 | 3.8 | 4.96 | |
| DFlashModel=Q3-8B, Thinking Mode=Enabled, Temperature=02026.05 | 3.72 | 5.19 | |
| DFlash+DDTreeModel=Qwen3-4B, Temperature=1.0, Node Budget=Best from {16, 32, 64, 128, 256, 512, 1024}2026.04 | 3.71 | 5.2 | |
| DFlash+DDTreeModel=Qwen3-8B, Temperature=1.0, Node Budget=Best from {16, 32, 64, 128, 256, 512, 1024}2026.04 | 3.47 | 4.86 | |
| EAGLE-3Model=Q3-4B, Thinking Mode=Enabled, Temperature=02026.05 | 3.47 | 5.33 | |
| EAGLE-3Model=Q3-8B, Thinking Mode=Enabled, Temperature=02026.05 | 3.38 | 5.64 | |
| Draft-OPDModel=Q3-4B, Thinking Mode=Enabled, Temperature=0.62026.05 | 3.38 | 5.13 | |
| Draft-OPDModel=Q3-8B, Thinking Mode=Disabled, Temperature=02026.05 | 3.33 | 6.57 | |
| Draft-OPDModel=Q3-4B, Thinking Mode=Disabled, Temperature=02026.05 | 3.18 | 6.6 | |
| DFlashModel=Q3-4B, Thinking Mode=Enabled, Temperature=0.62026.05 | 3.17 | 4.77 | |
| DFlashModel=Q3-8B, Thinking Mode=Disabled, Temperature=02026.05 | 3.17 | 6.04 | |
| Draft-OPDModel=Q3-8B, Thinking Mode=Enabled, Temperature=0.62026.05 | 3.13 | 5.05 | |
| DFlashModel=Q3-4B, Thinking Mode=Disabled, Temperature=02026.05 | 3.05 | 6.04 | |
| Draft-OPDModel=Q3-8B, Thinking Mode=Disabled, Temperature=0.62026.05 | 3.03 | 6.02 | |
| Draft-OPDModel=Q3-4B, Thinking Mode=Disabled, Temperature=0.62026.05 | 2.9 | 6.13 | |
| DFlashModel=Q3-8B, Thinking Mode=Enabled, Temperature=0.62026.05 | 2.88 | 4.66 | |
| DFlashModel=Q3-8B, Thinking Mode=Disabled, Temperature=0.62026.05 | 2.85 | 5.62 | |
| EAGLE-3Model=Q3-8B, Thinking Mode=Enabled, Temperature=0.62026.05 | 2.83 | 5.33 | |
| DFlashModel=Qwen3-Coder-30B-A3B-Instruct, Temperature=0.02026.04 | 2.77 | 3.61 | |
| DFlashModel=Q3-4B, Thinking Mode=Disabled, Temperature=0.62026.05 | 2.77 | 5.73 | |
| EAGLE-3Model=Q3-4B, Thinking Mode=Enabled, Temperature=0.62026.05 | 2.75 | 5.03 | |
| DFlashModel=Qwen3-4B, Temperature=0.02026.04 | 2.7 | 3.66 | |
| EAGLE-3Model=Q3-8B, Thinking Mode=Disabled, Temperature=02026.05 | 2.67 | 5.99 | |
| DFlashModel=Qwen3-8B, Temperature=0.02026.04 | 2.65 | 3.6 | |
| EAGLE-3Model=Q3-4B, Thinking Mode=Disabled, Temperature=02026.05 | 2.54 | 5.84 | |
| EAGLE-3Model=Q3-8B, Thinking Mode=Disabled, Temperature=0.62026.05 | 2.43 | 5.69 | |
| DFlashModel=Qwen3-Coder-30B-A3B-Instruct, Temperature=1.02026.04 | 2.42 | 3.16 | |
| EAGLE-3Model=Q3-4B, Thinking Mode=Disabled, Temperature=0.62026.05 | 2.41 | 5.66 | |
| DFlashModel=Qwen3-4B, Temperature=1.02026.04 | 2.29 | 3.07 | |
| DFlashModel=Qwen3-8B, Temperature=1.02026.04 | 2.1 | 2.82 |