Fault Localization on LINUXFLBENCH
52.4Recall@1SWE-Agent w/ LINUXFL+
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SWE-Agent w/ LINUXFL+Backbone=GPT-4o2025.05 | 52.4 | 72 | 76.8 | 61 | |
| AutoCodeRover w/ LINUXFL+Backbone=GPT-4o2025.05 | 50 | 71.2 | 74.4 | 58.9 | |
| SWE-Agent w/ LINUXFL+Backbone=Qwen3-32B2025.05 | 47.6 | 66.4 | 70.4 | 55.8 | |
| AutoCodeRover w/ LINUXFL+Backbone=Qwen3-32B2025.05 | 44 | 66.4 | 72 | 53.9 | |
| Agentless w/ LINUXFL+Backbone=GPT-4o2025.05 | 44 | 68.4 | 72.4 | 54.9 | |
| Agentless w/ LINUXFL+Backbone=Qwen3-32B2025.05 | 43.2 | 65.2 | 68.8 | 52.5 | |
| SWE-Agent2025.05 | 41.6 | 55.2 | 58.4 | 47.6 | |
| SWE-Agent2025.05 | 41.6 | 55.2 | 58.4 | 47.6 | |
| AutoCodeRover2025.05 | 38.8 | 49.6 | 49.6 | 43.5 | |
| AutoCodeRover2025.05 | 38.8 | 49.6 | 49.6 | 43.5 | |
| Agentless2025.05 | 36.8 | 49.2 | 50.4 | 41.9 | |
| Agentless2025.05 | 36.8 | 49.2 | 50.4 | 41.9 | |
| BLUiR2025.05 | 22.8 | 31.7 | 40.4 | 32.1 | |
| BM252025.05 | 16.8 | 32.8 | 39.6 | 23.1 | |
| BugLocator2025.05 | 12.7 | 20.9 | 27.2 | 21.5 | |
| Sentence-BERT2025.05 | 5.6 | 13.6 | 18 | 9 |