Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Issue Resolution research benchmarks · SOTA2 Research

Issue Resolution

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SWE-bench Verified (test)

Claude-4.5-Sonnet

77.2Pass Rate

36

Feb 26, 2026

SWE-Bench Sphinx Verified (test)

43.51Accuracy

3

Feb 26, 2026

SWE-Bench Sympy Verified (test)

51.11Accuracy

3

Feb 26, 2026

SWE-Bench Django Verified (test)

SERA-32B-Django

52.23Accuracy

3

Feb 26, 2026

httpx GitHub Issues OSS repo (10 randomly selected)

900Issues Resolved (%)

3

Feb 26, 2026

urllib3 GitHub Issues (10 randomly selected issues)

900Issue Resolution Rate

3

Feb 26, 2026

tinydb GitHub Issues OSS repo (10 randomly selected)

Claude 4 Sonnet

6Issues Resolved

3

Feb 26, 2026

python-qrcode GitHub Issues OSS GitHub repo (10 randomly selected issues)

8Issues Resolved

3

Feb 26, 2026

Pillow GitHub Issues OSS repo (10 randomly selected)

4Issues Resolved

3

Feb 26, 2026

poetry GitHub Issues OSS repo (10 randomly selected)

4Issues Resolved

3

Feb 26, 2026

requests GitHub Issues OSS GitHub repo (10 randomly selected issues)

8Resolved Issues

3

Feb 26, 2026

fashtext GitHub Issues OSS repo (10 randomly selected)

8Issues Resolved

3

Feb 26, 2026

arrow-py OSS GitHub repo (10 randomly selected issues)

6Issues Resolved

3

Feb 26, 2026

jsonpickle GitHub Issues OSS repo (10 randomly selected)

9Issues Resolved

3

Feb 26, 2026

Popular datasets

SWE-Bench jsonpickle arrow-py fashtext requests

Follow for updates

Join SOTA2 Contact