Automated Program Repair on 10 projects (100 total issues)
70Total Solved IssuesAIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AIR2025.12 | 70 | 0.7 | 7 | 8 | 2.05 | 4 | 9 | |
| Gemini-2.5 pro2025.12 | 41 | 0.41 | 4.1 | 3.5 | 2.56 | 0 | 8 | |
| Claude 4 Sonnet2025.12 | 28 | 0.28 | 2.8 | 2.5 | 1.93 | 0 | 6 |
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AIR2025.12 | 70 | 0.7 | 7 | 8 | 2.05 | 4 | 9 | |
| Gemini-2.5 pro2025.12 | 41 | 0.41 | 4.1 | 3.5 | 2.56 | 0 | 8 | |
| Claude 4 Sonnet2025.12 | 28 | 0.28 | 2.8 | 2.5 | 1.93 | 0 | 6 |