Automated Theorem Proving on Metamath (val)
56.5Performance700m policy+value a = 32
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| 700m policy+value a = 32Parameters=700m, Test-time compute=Increased, Alpha=322020.09 | 56.5 | 9.2 | — | — | — | |
| 700m policy+valueParameters=700m, Optimization=Iterated learned value function2020.09 | 47.21 | 4.6 | — | — | — | |
| 700m WebMathParameters=700m, Pre-training=WebMath2020.09 | 42.56 | 10.9 | — | — | — | |
| 700mParameters=700m2020.09 | 31.58 | 2.5 | — | — | — | |
| 160mParameters=160m, Architecture=Transformers2020.09 | 28.96 | 7.8 | — | — | — | |
| MetaGen-ILDescription=Baseline and state of the art.2020.09 | 21.16 | — | — | — | — | |
| Evaristetraining=online training2022.05 | — | — | 82.6 | 81 | 81.2 | |
| Supervisedtraining=supervised2022.05 | — | — | — | 61 | 65.4 |