Issue Resolution on requests GitHub Issues OSS GitHub repo (10 randomly selected issues)
8Resolved IssuesAIR
Evaluation results
| Method | Links | |
|---|---|---|
| AIRwall-clock budget=same, tool budget=same2025.12 | 8 | |
| Gemini-2.5 prowall-clock budget=same, tool budget=same2025.12 | 8 | |
| Claude 4 Sonnetwall-clock budget=same, tool budget=same2025.12 | 3 |