Lean
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Lean (test)
73Pass@1
14
Lean 4 (val)
49.8Pass@1
6
Lean Augmented Statement
82.7R@1
4
Lean Synthetic User Query (Sec. 3.1)
54.4Recall@1
4
Lean Informalized Statement
64.2R@1
4
Lean Augmented Statement cleaned (test)
86.8R@1
2
Lean Synthetic User Query cleaned (test)
57.3Recall@1
2
Lean Informalized Statement cleaned (test)
65.7R@1
2