Software Engineering
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
72.4Generic Score
4
Apr 2, 2026
73.6Success Rate (SR)
4
Mar 9, 2026
30.8Resolved Percentage
4
Feb 26, 2026
74.2Accuracy
3
Jun 30, 2026
55.4Avg@16
3
Jun 23, 2026
77.1Score
3
Apr 16, 2026
59Resolution Rate
3
Feb 26, 2026
42Resolution Rate
2
May 11, 2026
53.3Overall Score
2
Apr 2, 2026
60.7Accuracy
2
Apr 2, 2026
0.335Functional Correctness
2
Feb 26, 2026
—
—Primary metric
0
Feb 26, 2026
—
—Primary metric
0
Feb 26, 2026
—
—Primary metric
0
Feb 26, 2026