RE-Bench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
RE-Bench Weighted
93.2Success Rate
32
RE-Bench Hard tier
89.8Success Rate
32
RE-Bench Medium tier
100Success Rate
32
RE-Bench Easy tier
100Success Rate
32
RE-Bench Category C: Failure
81.4Accuracy
2
RE-Bench Category A: Fidelity
92.1Accuracy
2