SWE-Bench

SWE-Bench OpenHands

4

SWE-bench Lite (test)

4

SWE-Bench

4

SWE-bench Lite (50 tasks)

4

SWE-Bench Verified

4

SWE-Bench Lite

4

SWE-bench

4

SWE-Bench Pro (public)

4

SWE-bench Lite

4

SWE-bench 14 tasks

4

SWE-bench verified

4

SWE-bench Lite

4

SWE-bench Verified

4

SWE-bench Multilingual (test)

4

SWE Verified OpenHands

4

SWE-bench Verified 500 issues (Protocol A)

4

SWE-Bench Live Lite

4

SWE-Bench AgentLess Repair

4

SWE-bench 500 (test)

4

SWE-Bench Verified

3

SWE-bench Verified (all 500 problems)

3

SWE-Bench Verified

3

SWE-bench Verified (held-out agent data)

3

SWE-Bench Python subset Pro

3

SWE-Bench Sphinx Verified (test)

3