Program Repair
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
100Repair Success Rate
60
Jul 1, 2026
84Pass Rate
18
May 21, 2026
90.63ACC
12
Feb 26, 2026
71.7Accuracy
9
Feb 26, 2026
91.2BLEU-4
7
Feb 27, 2026
80.1BLEU-4
7
Feb 27, 2026
12.5Strict Accuracy
4
Feb 26, 2026
21.7Strict Accuracy
4
Feb 26, 2026