Code Localization on MuLocBench
6.4Mean Latency (s)BM25
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BM252026.05 | 6.4 | 1.6 | |
| mini-swe-agentModel=GPT-5.22026.05 | 32.3 | 23.6 | |
| AgentlessModel=GPT-5.22026.05 | 39.3 | 15.8 | |
| SWE-agentModel=GPT-5.22026.05 | 72.3 | 58.8 | |
| Claude CodeInterface=Native2026.05 | 98.3 | 81.7 | |
| LARGERModel=GPT-5.22026.05 | 99.9 | 71.6 | |
| CoSILModel=GPT-5.22026.05 | 109.7 | 58.1 | |
| CodexInterface=Native2026.05 | 139.9 | 132.8 | |
| LocAgentModel=GPT-5.22026.05 | 263.4 | 65.7 | |
| OpenHandsInterface=Native2026.05 | 635.7 | 474.6 |