Issue Resolution on httpx GitHub Issues OSS repo (10 randomly selected)
900Issues Resolved (%)AIR
Evaluation results
| Method | Links | |
|---|---|---|
| AIRwall-clock budget=same, tool budget=same2025.12 | 900 | |
| Claude 4 Sonnetwall-clock budget=same, tool budget=same2025.12 | 400 | |
| Gemini-2.5 prowall-clock budget=same, tool budget=same2025.12 | 300 |