Software Engineering Problem Solving
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
47.3Resolve Rate
18
May 6, 2026
78Average Success Rate @1
10
Jun 11, 2026
25.8Rounds Taken
6
May 18, 2026
10.67Add. Solved
5
Jun 8, 2026
57.333Resolution Rate
2
May 11, 2026