Software Engineering
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
16.1Accuracy
8
Feb 26, 2026
76.2Success Rate
7
Jun 16, 2026
75.1Public Score
7
Jun 12, 2026
78.2SWE-Agent Score
7
Mar 4, 2026
28.8Acc
7
Feb 26, 2026
0FCR
6
Jul 7, 2026
286n_mix
6
Jun 23, 2026
32Accuracy
6
May 4, 2026
23.6Reproduced Success Rate
6
Mar 20, 2026
71Worst-Case Success Rate
6
Feb 26, 2026
73.7Score
5
Jun 23, 2026
81.9MTP Acceptance Rate
5
Jun 11, 2026
78Pass Rate
5
Jun 5, 2026
83.3WR (%)
5
May 21, 2026
72.4WR (%)
5
May 21, 2026
62.7Resolve Rate
4
Jul 7, 2026
59.27F1 Score
4
Jun 30, 2026
53.68F1 Score
4
Jun 30, 2026
49.64F1 Score
4
Jun 30, 2026
56.12F1 Score
4
Jun 30, 2026
57.9F1 Score
4
Jun 30, 2026
55.72F1 Score
4
Jun 30, 2026
21.4Productivity
4
Jun 15, 2026
84.6Success Rate
4
May 19, 2026
98Baseline Accuracy
4
May 13, 2026