Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Execution research benchmarks · SOTA2 Research

Code Execution

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Live Code Execution

62.04Pass@1

21

May 29, 2026

Multi-Agent Evaluation Set

100R@5

6

Feb 26, 2026

Code Exec 5 variables (test)

93.2Accuracy

6

Feb 26, 2026

Code Exec 3 variables (test)

99Accuracy

6

Feb 26, 2026

AutoHealth Medical Benchmark Suite Tasks T1-T17

1T1 Execution Result

5

Feb 26, 2026

Health Benchmark

1T1

5

Feb 26, 2026

CodeNetMut (test)

48.06Output Accuracy

4

Feb 26, 2026

Tutorial (test)

79.51Output Accuracy

4

Feb 26, 2026

Qwen-Agent Code Interpreter Average

70.5Accuracy

3

Feb 26, 2026

Qwen-Agent Code Interpreter Visualization-Easy

68.4Accuracy

3

Feb 26, 2026

Qwen-Agent Code Interpreter Visualization-Hard

72.6Accuracy

3

Feb 26, 2026

SingleLine (test)

94.03Trace Accuracy

3

Feb 26, 2026

Popular datasets

Qwen-Agent Code Interpreter Code Exec SingleLine Tutorial CodeNetMut

Follow for updates

Join SOTA2 Contact