Code Repair
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
15.7Repair Rate
21
Feb 26, 2026
85.5Fix Success Rate
20
Feb 26, 2026
59.1Success Rate (Python)
19
Jun 4, 2026
15.36Top-1 Exact Match Accuracy
6
Feb 26, 2026
24.04Top-1 Accuracy
6
Feb 26, 2026
0.77r
5
Mar 24, 2026
82.1Pass@1
5
Feb 27, 2026
523Pass Count
4
May 26, 2026
5.34ASR
3
Jun 11, 2026
1.92ASR
3
Jun 11, 2026
6.77ASR
3
Jun 11, 2026
12.21ASR
3
Jun 11, 2026
13.46Top-1 Acc
2
Feb 26, 2026
23.86Top-1 Acc
2
Feb 26, 2026
—
—Pass@1
0
Feb 26, 2026