Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

ScienceAgentBench dataset and benchmarks · SOTA2 Research

Research Datasets

ScienceAgentBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Scientific Agent Task Completion

ScienceAgentBench

43.1Success Rate (SR)

40

Scientific Code Generation

ScienceAgentBench (test)

32.8SR

32

Scientific Discovery

ScienceAgentBench

0.225Score

24

Defect Detection

ScienceAgentBench 12 confirmed defects, 102 tasks

100Recall Average (RecA)

12

Scientific Code Generation

ScienceAgentBench

25.5SR

10

Scientific Agent Task

ScienceAgentBench (test)

18.6Success Rate (SR)

6

Scientific-coding

ScienceAgentBench deterministic-eval 2024

47.4Pass Rate

5

Popular tasks

Scientific Code Generation Defect Detection Scientific Discovery Scientific Coding Scientific Agent Task

Follow for updates

Join SOTA2 Contact