List your company

ResearchFormerly WizWand

ScienceAgentBench

Benchmarks

TaskDatasetSOTA resultTrendResults

Scientific Agent Task Completion

ScienceAgentBench

43.1Success Rate (SR)

40

Scientific Code Generation

ScienceAgentBench (test)

32.8SR

32

Scientific Discovery

ScienceAgentBench

0.225Score

24

Defect Detection

ScienceAgentBench 12 confirmed defects, 102 tasks

100Recall Average (RecA)

12

Scientific Code Generation

ScienceAgentBench

25.5SR

10

Scientific Agent Task

ScienceAgentBench (test)

18.6Success Rate (SR)

6

Scientific-coding

ScienceAgentBench deterministic-eval 2024

47.4Pass Rate

5