Formal Mathematics on Lean-Workbook 2,500-problem (test)
57.1PCR (%)TRI (Full)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TRI (Full)Fine-tuning Protocol=SFT + DPO + Repair2026.06 | 57.1 | 1,268 | |
| TRI (SFT + DPO)Fine-tuning Protocol=SFT + DPO2026.06 | 55.4 | 1,267 | |
| InternLM-StepProver + CoT-SCBackbone=InternLM-StepProver, Decoding Strategy=CoT-SC(k=8)2026.06 | 51.2 | 15,896 | |
| TRI (SFT only)Fine-tuning Protocol=SFT only2026.06 | 49.7 | 1,534 | |
| InternLM-StepProver + CoTBackbone=InternLM-StepProver, Decoding Strategy=CoT2026.06 | 44.9 | 1,987 | |
| Qwen2.5-72B + CoT-SCBackbone=Qwen2.5-72B, Decoding Strategy=CoT-SC2026.06 | 43.1 | 29,472 | |
| Qwen2.5-72B + CoTBackbone=Qwen2.5-72B, Decoding Strategy=CoT2026.06 | 38.2 | 1,842 | |
| Llama-3.1-70B + ToTBackbone=Llama-3.1-70B, Decoding Strategy=ToT(b=5)2026.06 | 37.4 | 9,561 | |
| Llama-3.1-70B + CoTBackbone=Llama-3.1-70B, Decoding Strategy=CoT2026.06 | 33.6 | 1,913 |