LeanDojo
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
LeanDojo (random)
53.21Pass@1
16
LeanDojo (novel premises)
41.11Pass@1
12
LeanDojo Benchmark 4 Lean 3 (novel_premises)
9.8R@1
6
LeanDojo Benchmark (random)
13.5R@1
5
LeanDojo (test)
58.25Pass Rate
2
LeanDojo Benchmark 4 Lean 3 (random)
48.6Pass@1
2