Autoformalization on PRIME
80.13Success Count (SC)DSR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DSRPass@k=4, Computational budget=4 inference calls2026.04 | 80.13 | 67.95 | |
| Goedel-V2-Formalizer-32BPass@k=4, Computational budget=4 inference calls2026.04 | 77.56 | 66.67 | |
| Goedel-V2-Formalizer-8BPass@k=4, Computational budget=4 inference calls2026.04 | 75.64 | 60.26 | |
| Kimina-Autoformalizer-7BPass@k=4, Computational budget=4 inference calls2026.04 | 75 | 48.08 | |
| Qwen3-MaxPass@k=4, Computational budget=4 inference calls2026.04 | 63.46 | 56.41 | |
| StepFun-Formalizer-32BPass@k=4, Computational budget=4 inference calls2026.04 | 57.69 | 50 | |
| StepFun-Formalizer-7BPass@k=4, Computational budget=4 inference calls2026.04 | 47.44 | 42.31 |