Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Software Engineering Task Resolution research benchmarks · SOTA2 Research

Software Engineering Task Resolution

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SWE-bench Verified

73.3Resolution Rate

63

May 14, 2026

SWE-Bench Verified

61.6Success Rate (SR)

14

Jun 12, 2026

SWE-Gym (Holdout)

19Task Resolution Rate

12

May 14, 2026

Qwen3-Coder 480B/A35B Instruct

24.7Resolution Rate

11

Feb 26, 2026

SWE-bench In-Distribution

52.34Resolved Rate

9

May 15, 2026

SWE-agent task distribution

74,000Tokens per Success

3

Jun 16, 2026

Popular datasets

SWE-Bench SWE-Gym SWE-agent

Follow for updates

Join SOTA2 Contact