Automated Program Repair
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
100Pass@1 Rate
16
May 12, 2026
84.5Pass@1 Rate
16
May 12, 2026
24.8Pass@1
16
May 12, 2026
41Pass@1 Rate
16
May 12, 2026
64V2.0 Count
7
Feb 26, 2026
15Chart Success Count
7
Feb 26, 2026
45.2Compilation Success Rate
6
Feb 26, 2026
27.8Compilation Success Rate
6
Feb 26, 2026
20.3Compilation Success Rate
5
Feb 26, 2026
95.6Typo Success Rate
4
Feb 26, 2026
70Total Solved Issues
3
Feb 26, 2026