Software Engineering Issue Resolution
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
89.2Resolution Rate
110
Jun 24, 2026
59.9Pass@1
21
Jun 17, 2026
73.5Resolution Rate
16
Feb 26, 2026
53.7Pass@1
10
Apr 28, 2026
45.78Resolve Rate
6
Apr 15, 2026
68Pass@1
5
May 15, 2026
32.5Resolve Rate
4
Feb 26, 2026
20Resolution Rate
4
Feb 26, 2026
0.224Resolve Rate
4
Feb 26, 2026
72.2Resolution Score
4
Feb 26, 2026