Formal Theorem Proving on mathlib (test)
63Pass@1θ_mathlib (expert iterated on mathlib-train)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| θ_mathlib (expert iterated on mathlib-train)search width (d)=512, expansion factor (e)=8, parameters=774M2022.02 | 63 | 71.5 | 77.1 | |
| θ_full (expert iterated on full curriculum)search width (d)=512, expansion factor (e)=8, parameters=774M2022.02 | 62.9 | 71.6 | 76.3 | |
| θ₁ (value-function based search)search width (d)=512, expansion factor (e)=8, parameters=774M2022.02 | 56.5 | 66.9 | 73.7 |