Issue Resolution on arrow-py OSS GitHub repo (10 randomly selected issues)
6Issues ResolvedAIR
Evaluation results
| Method | Links | |
|---|---|---|
| AIRwall-clock budget=same, tool budget=same2025.12 | 6 | |
| Claude 4 Sonnetwall-clock budget=same, tool budget=same2025.12 | 4 | |
| Gemini-2.5 prowall-clock budget=same, tool budget=same2025.12 | 4 |