Issue Resolution on urllib3 GitHub Issues (10 randomly selected issues)
900Issue Resolution RateAIR
Evaluation results
| Method | Links | |
|---|---|---|
| AIRwall-clock budget=same, tool budget=same2025.12 | 900 | |
| Gemini-2.5 prowall-clock budget=same, tool budget=same2025.12 | 700 | |
| Claude 4 Sonnetwall-clock budget=same, tool budget=same2025.12 | 200 |