List your company

ResearchFormerly WizWand

Issue Resolution

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

SWE-bench Verified (test)

Claude-4.5-Sonnet

77.2Pass Rate

36

Feb 26, 2026

SWE-Bench Sphinx Verified (test)

43.51Accuracy

3

Feb 26, 2026

SWE-Bench Sympy Verified (test)

51.11Accuracy

3

Feb 26, 2026

SWE-Bench Django Verified (test)

SERA-32B-Django

52.23Accuracy

3

Feb 26, 2026

httpx GitHub Issues OSS repo (10 randomly selected)

900Issues Resolved (%)

3

Feb 26, 2026

urllib3 GitHub Issues (10 randomly selected issues)

900Issue Resolution Rate

3

Feb 26, 2026

tinydb GitHub Issues OSS repo (10 randomly selected)

Claude 4 Sonnet

6Issues Resolved

3

Feb 26, 2026

python-qrcode GitHub Issues OSS GitHub repo (10 randomly selected issues)

8Issues Resolved

3

Feb 26, 2026

Pillow GitHub Issues OSS repo (10 randomly selected)

4Issues Resolved

3

Feb 26, 2026

poetry GitHub Issues OSS repo (10 randomly selected)

4Issues Resolved

3

Feb 26, 2026

requests GitHub Issues OSS GitHub repo (10 randomly selected issues)

8Resolved Issues

3

Feb 26, 2026

fashtext GitHub Issues OSS repo (10 randomly selected)

8Issues Resolved

3

Feb 26, 2026

arrow-py OSS GitHub repo (10 randomly selected issues)

6Issues Resolved

3

Feb 26, 2026

jsonpickle GitHub Issues OSS repo (10 randomly selected)

9Issues Resolved

3

Feb 26, 2026