Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Software Engineering Problem Solving research benchmarks · SOTA2 Research

Software Engineering Problem Solving

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

47.3Resolve Rate

18

May 6, 2026

SWE-bench Verified

78Average Success Rate @1

10

Jun 11, 2026

SWE-Bench Verified

Mini SWE Agent + LaMR

25.8Rounds Taken

6

May 18, 2026

SWE-Bench hard problem subset

10.67Add. Solved

5

Jun 8, 2026

SWE-bench Lite (test)

57.333Resolution Rate

2

May 11, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact