Software Engineering on SWE Lite
10,538Throughput (tok/s)Draft-OPD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Draft-OPDBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=32, Inference Engine=SGLang2026.05 | 10,538 | 10 | 6.12 | |
| DFlashBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=32, Inference Engine=SGLang2026.05 | 9,604 | — | 5.62 | |
| Draft-OPDBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=16, Inference Engine=SGLang2026.05 | 8,568 | 11 | 6.12 | |
| DFlashBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=16, Inference Engine=SGLang2026.05 | 7,743 | — | 5.62 | |
| Draft-OPDBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=32, Inference Engine=SGLang2026.05 | 6,904 | 13 | 5.27 | |
| DFlashBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=32, Inference Engine=SGLang2026.05 | 6,113 | — | 4.6 | |
| Draft-OPDBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=16, Inference Engine=SGLang2026.05 | 5,611 | 11 | 5.27 | |
| Draft-OPDBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=8, Inference Engine=SGLang2026.05 | 5,544 | 11 | 6.12 | |
| DFlashBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=16, Inference Engine=SGLang2026.05 | 5,051 | — | 4.6 | |
| DFlashBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=8, Inference Engine=SGLang2026.05 | 5,009 | — | 5.62 | |
| Draft-OPDBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=8, Inference Engine=SGLang2026.05 | 3,879 | 15 | 5.27 | |
| Draft-OPDBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=32, Inference Engine=SGLang2026.05 | 3,850 | 11 | 3.81 | |
| DFlashBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=32, Inference Engine=SGLang2026.05 | 3,453 | — | 3.43 | |
| DFlashBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=8, Inference Engine=SGLang2026.05 | 3,347 | — | 4.6 | |
| Draft-OPDBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=4, Inference Engine=SGLang2026.05 | 3,230 | 8 | 6.12 | |
| DFlashBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=4, Inference Engine=SGLang2026.05 | 2,983 | — | 5.62 | |
| Draft-OPDBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=16, Inference Engine=SGLang2026.05 | 2,579 | 10 | 3.81 | |
| DFlashBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=16, Inference Engine=SGLang2026.05 | 2,337 | — | 3.43 | |
| Draft-OPDBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=4, Inference Engine=SGLang2026.05 | 2,263 | 15 | 5.27 | |
| DFlashBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=4, Inference Engine=SGLang2026.05 | 1,962 | — | 4.6 | |
| Draft-OPDBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=8, Inference Engine=SGLang2026.05 | 1,628 | 9 | 3.81 | |
| DFlashBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=8, Inference Engine=SGLang2026.05 | 1,484 | — | 3.43 | |
| Draft-OPDBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=1, Inference Engine=SGLang2026.05 | 976 | 8 | 6.12 | |
| Draft-OPDBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=4, Inference Engine=SGLang2026.05 | 960 | 11 | 3.81 | |
| DFlashBackbone Model=Qwen3-4B (Enable Thinking), Concurrency=1, Inference Engine=SGLang2026.05 | 901 | — | 5.62 | |
| DFlashBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=4, Inference Engine=SGLang2026.05 | 855 | — | 3.43 | |
| Draft-OPDBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=1, Inference Engine=SGLang2026.05 | 644 | 9 | 5.27 | |
| DFlashBackbone Model=Qwen3-8B (Enable Thinking), Concurrency=1, Inference Engine=SGLang2026.05 | 592 | — | 4.6 | |
| Draft-OPDBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=1, Inference Engine=SGLang2026.05 | 352 | 10 | 3.81 | |
| DFlashBackbone Model=Qwen3-30B-A3B-Thinking-2507, Concurrency=1, Inference Engine=SGLang2026.05 | 319 | — | 3.43 |