Premise Selection on LeanDojo Benchmark 4 Lean 3 (novel_premises)
9.8R@1ReProver
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ReProversplit=novel_premises2023.06 | 9.8 | 32.1 | 24 | |
| ReProver (Ours)2023.06 | 9.1 | 27.6 | 24 | |
| ReProver (Ours)Use in-file negatives=false2023.06 | 7.9 | 25.7 | 22 | |
| ReProver (Ours)Premise Set=All premises2023.06 | 7.1 | 23.1 | 20 | |
| BM252023.06 | 5.9 | 15.5 | 14 | |
| BM25Premise Set=All premises2023.06 | 2.1 | 12.4 | 8 |