Software Engineering Issue Resolution on Multi-SWE-Bench Mini
20Resolution RateHybrid
Evaluation results
| Method | Links | |
|---|---|---|
| HybridFeedback=Hybrid (Execution-free + Execution-based)2025.12 | 20 | |
| Execution-free onlyFeedback=Execution-free (SWE-RM)2025.12 | 18.8 | |
| Execution-based onlyFeedback=Execution-based2025.12 | 18.5 | |
| Poor Calibrated RMFeedback=Ablated RM (Poorly Calibrated)2025.12 | 10 |