Software Engineering on SWE-Bench Verified (Res%, QR, CS, Mis.)
86.2Resolution Rate (%)Oracle Routing
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Oracle Routing2026.05 | 86.2 | 100 | — | 0 | |
| HyDRA (peak)τ=0.012026.05 | 75.4 | 87.5 | 12.9 | 81 | |
| Claude Sonnet 4.6 (strong)2026.05 | 74.2 | 86.1 | 0 | 82.4 | |
| HyDRA (cons.)τ=0.242026.05 | 74 | 85.8 | 54.1 | 70.2 | |
| Binary router2026.05 | 73.8 | 85.6 | 9.1 | 75 | |
| GPT-5.3 Codex2026.05 | 73.4 | 85.2 | 57.3 | 78 | |
| GPT-5.42026.05 | 73.4 | 85.2 | 25.7 | 85 | |
| HyDRA (agg.)τ=0.642026.05 | 71 | 82.4 | 72.5 | 19.8 | |
| GPT-5.4-mini (cheap)2026.05 | 69.4 | 80.5 | 78.6 | 0 | |
| Claude Haiku 4.52026.05 | 69.4 | 80.5 | 11.7 | 69.4 |