Software Engineering Task Resolution
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
73.3Resolution Rate
63
May 14, 2026
61.6Success Rate (SR)
14
Jun 12, 2026
19Task Resolution Rate
12
May 14, 2026
24.7Resolution Rate
11
Feb 26, 2026
52.34Resolved Rate
9
May 15, 2026
74,000Tokens per Success
3
Jun 16, 2026