SWE-Bench

SWE-bench Multilingual

14

SWE-bench Lite

14

SWE-Bench Pro 1.0 (test)

14

SWE-Bench Multi

13

SWE-Bench Multilingual

13

SWE-bench

12

SWE-bench OpenHands

12

SWE-Bench Verified (held-out (sample of 150))

12

SWE-bench distinct-shard topology

12

SWE-Bench-Verified (50 cases)

12

SWE-Bench SWE-Agent-style workflows Verified

12

SWE-bench Verified

12

SWE-bench Lite Oracle (test)

12

SWE-bench Verified single-run, single-patch evaluation protocol (test)

11

SWE-BENCH LIVE

11

SWE-bench Verified

10

SWE-bench Verified

10

SWE-Bench Verified

10

SWE-Bench Lite

10

SWE-bench Multilingual

10

SWE-Bench Lite

9

SWE-bench

9

SWE-bench Pro

9

SWE-bench In-Distribution

9

SWE-bench

9