ReplicationBench
Benchmarks
TaskDatasetSOTA resultTrendResults
ReplicationBench
27.8Pass@3
13
ReplicationBench
17.8Pass@1
9
ReplicationBench 27 tasks (all)
93.3Faithfulness
3
ReplicationBench (full mode)
60Match Rate
3
ReplicationBench paper-only
33.3Match Rate
3