Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Software Engineering research benchmarks – Page 3 · SOTA2 Research

Software Engineering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SWE-bench Verified

72.4Generic Score

4

Apr 2, 2026

SWE-bench Verified 500 issues (Protocol A)

OpenHands CodeAct + GBT-SE

73.6Success Rate (SR)

4

Mar 9, 2026

SWE-Bench AgentLess Repair

MiMo-V2-Flash Base

30.8Resolved Percentage

4

Feb 26, 2026

SWE-Bench Verified

74.2Accuracy

3

Jun 30, 2026

SWE-bench Verified (all 500 problems)

Random rollout selection

55.4Avg@16

3

Jun 23, 2026

SWE-Bench Verified

77.1Score

3

Apr 16, 2026

SWE-Bench Python subset Pro

59Resolution Rate

3

Feb 26, 2026

Terminal-Bench full 80-task old-core set 1.1

42Resolution Rate

2

May 11, 2026

SWE Verified MEDIUM reasoning

53.3Overall Score

2

Apr 2, 2026

SWE Verified HIGH reasoning

60.7Accuracy

2

Apr 2, 2026

Software Engineering

0.335Functional Correctness

2

Feb 26, 2026

Sphinx 64K context 44 samples

—

—Primary metric

0

Feb 26, 2026

Sympy 64K context 75 samples

—

—Primary metric

0

Feb 26, 2026

Django 64K context 231 samples

—

—Primary metric

0

Feb 26, 2026

Page 3 of 3

Popular datasets

SWE-Bench SWE tasks SWE SWE-rebench Terminal-bench

Follow for updates

Join SOTA2 Contact