Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Coding Agent research benchmarks · SOTA2 Research

Coding Agent

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SWE-bench Verified single-run, single-patch evaluation protocol (test)

51.6Resolution Rate

11

May 19, 2026

Aggregated (RebenchT, CodeCI, Bird)

34.99Overall Average Score

5

Feb 26, 2026

43.83Pass@1

5

Feb 26, 2026

39.43Avg@2

5

Feb 26, 2026

33.13OH-p@1

5

Feb 26, 2026

Popular datasets

BIRD SWE-Bench RebenchT CodeCI Aggregated (RebenchT, CodeCI, Bird)

Follow for updates

Join SOTA2 Contact