Formal Theorem Proving on STP In-domain
2,604.24Average Token CostSegment-level
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Segment-levelTraining data=STP2026.05 | 2,604.24 | 41.55 | — | |
| Whole-proof-segTraining data=STP2026.05 | 2,906.41 | 50.52 | — | |
| Step-levelTraining data=STP2026.05 | 4,768.51 | 73.5 | — | |
| Whole-proofTraining data=STP2026.05 | 12,169.05 | 42.67 | — | |
| Segment-levelTraining data=STP, Base Model=Qwen2.5-Math-7B, Supervision granularity=Segment-level2026.05 | — | — | 97.32 | |
| Step-levelTraining data=STP, Base Model=Qwen2.5-Math-7B, Supervision granularity=Step-level2026.05 | — | — | 97.8 | |
| Whole-proofTraining data=STP, Base Model=Qwen2.5-Math-7B, Supervision granularity=Whole-proof2026.05 | — | — | 98.12 | |
| Whole-proof-segTraining data=STP, Base Model=Qwen2.5-Math-7B, Evaluation protocol=Segment-style search interface2026.05 | — | — | 95.72 |