Code Localization Resource Usage on MuLocBench
0.03Cost/InstanceAgentless
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AgentlessModel=GPT-5.22026.05 | 0.03 | 17,800 | — | |
| CoSILModel=GPT-5.22026.05 | 0.04 | 18,700 | — | |
| mini-swe-agentModel=GPT-5.22026.05 | 0.09 | — | 15.6 | |
| SWE-agentModel=GPT-5.22026.05 | 0.12 | 96,100 | 14.9 | |
| LARGERModel=GPT-5.22026.05 | 0.44 | 353,000 | 13 | |
| CodexInterface=native2026.05 | 0.98 | 521,800 | — | |
| LocAgentModel=GPT-5.22026.05 | 1.26 | 711,500 | — | |
| OpenHandsModel=GPT-5.22026.05 | — | — | 22.9 |