Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

SWE-agent dataset and benchmarks · SOTA2 Research

Research Datasets

SWE-agent

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Failure prediction

SWE-agent (Transfer held-out)

0.69ROC-AUC

7

Failure prediction

SWE-agent (Within corpus)

0.713ROC-AUC

4

Software engineering task resolution

SWE-agent task distribution

74,000Tokens per Success

3

Popular tasks

Failure Prediction Software Engineering Task Resolution

Follow for updates

Join SOTA2 Contact