Formal Theorem Proving on miniF2F
228.64Average Token CostStep-level
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Step-levelTraining data=LeanWorkbook2026.05 | 228.64 | 3.87 | |
| Segment-levelTraining data=LeanWorkbook2026.05 | 446.36 | 6.84 | |
| Whole-proof-segTraining data=STP2026.05 | 457.82 | 6.82 | |
| Segment-levelTraining data=STP2026.05 | 543.98 | 11.88 | |
| Whole-proof-segTraining data=LeanWorkbook2026.05 | 611.07 | 11.24 | |
| Step-levelTraining data=STP2026.05 | 809.31 | 14.54 | |
| Segment-levelTraining data=NuminaMath-LEAN2026.05 | 1,149.8 | 10.55 | |
| Whole-proof-segTraining data=NuminaMath-LEAN2026.05 | 1,199.51 | 15.13 | |
| Step-levelTraining data=NuminaMath-LEAN2026.05 | 2,141.8 | 21.21 | |
| Whole-proofTraining data=LeanWorkbook2026.05 | 2,554.67 | 14.15 | |
| Whole-proofTraining data=STP2026.05 | 3,198.5 | 18 | |
| Whole-proofTraining data=NuminaMath-LEAN2026.05 | 4,147.67 | 23 |