Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Program Repair research benchmarks · SOTA2 Research

Program Repair

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Real misspecified programs neutral briefs

Gemini-2.5-flash

100Repair Success Rate

60

Jul 1, 2026

SpreadsheetBench (test)

84Pass Rate

18

May 21, 2026

90.63ACC

12

Feb 26, 2026

71.7Accuracy

9

Feb 26, 2026

Bugs2Fix (medium)

91.2BLEU-4

7

Feb 27, 2026

Bugs2Fix (small)

80.1BLEU-4

7

Feb 27, 2026

Code-Contests (test)

Assistive Decomp

12.5Strict Accuracy

4

Feb 26, 2026

Assistive Decomp

21.7Strict Accuracy

4

Feb 26, 2026

Popular datasets

Bugs2Fix DeepFix APPS Code-Contests SpreadSheetBench

Follow for updates

Join SOTA2 Contact