Resolution on Software Repository
24.32CoverageTIDE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TIDEBackbone=Gemini 3.5 Flash2026.06 | 24.32 | 26.98 | |
| TIDEBackbone=Claude Sonnet 4.52026.06 | 15.79 | 17.76 | |
| TIDEBackbone=GPT-5 mini2026.06 | 15.52 | 17.39 | |
| MULTI-AGENTBackbone=Gemini 3.5 Flash2026.06 | 15.32 | 18.89 | |
| SINGLE-AGENTBackbone=Gemini 3.5 Flash2026.06 | 15.08 | 18.71 | |
| SINGLE-AGENTBackbone=GPT-5 mini2026.06 | 12.19 | 13.27 | |
| MULTI-AGENTBackbone=GPT-5 mini2026.06 | 9.89 | 12.39 | |
| SINGLE-AGENTBackbone=Claude Sonnet 4.52026.06 | 9.84 | 12.34 | |
| MULTI-AGENTBackbone=Claude Sonnet 4.52026.06 | 8.88 | 11.01 | |
| TIDEBackbone=Qwen 3.6 Flash2026.06 | 8.47 | 9.7 | |
| MULTI-AGENTBackbone=Qwen 3.6 Flash2026.06 | 5.83 | 6.5 | |
| SINGLE-AGENTBackbone=Qwen 3.6 Flash2026.06 | 4.84 | 5.76 |