Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

ReplicationBench dataset and benchmarks · SOTA2 Research

Research Datasets

ReplicationBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

ReplicationBench

27.8Pass@3

13

Research Replication

ReplicationBench

17.8Pass@1

9

Research Replication

ReplicationBench 27 tasks (all)

93.3Faithfulness

3

Research Replication

ReplicationBench (full mode)

60Match Rate

3

Research Replication

ReplicationBench paper-only

33.3Match Rate

3

Popular tasks

Research Replication Code Generation

Follow for updates

Join SOTA2 Contact