Theorem Proving on Putnam-Bench
87.9Pass@32Seed-Prover 1.5
Evaluation results
| Method | Links | |
|---|---|---|
| Seed-Prover 1.5Budget (b)=UNK2026.03 | 87.9 | |
| Seed-ProverBudget (b)=UNK2026.03 | 50.4 | |
| LongCat-Flash-ProverMode=sketch-proof, Search Strategy=TIR & Tree Search, Budget (b)=1182026.03 | 41.5 | |
| LongCat-Flash-ProverMode=sketch-proof, Search Strategy=TIR, Budget (b)=1182026.03 | 31.7 | |
| LongCat-Flash-ProverEvaluation Mode=sketch-proof mode, TIR (Tool-Integrated Reasoning)=true2026.03 | 28.9 | |
| Goedel-Prover-V2-32B w/ self-correctionBudget (b)=1842026.03 | 13 | |
| LongCat-Flash-ProverEvaluation Mode=whole-proof mode, TIR (Tool-Integrated Reasoning)=true2026.03 | 10.4 | |
| Goedel-Prover-V2-32BModel Category=Open-Weights Prover Models, Self-correction=true2026.03 | 8.6 | |
| DeepSeek-Prover-V2-671BBudget (b)=1,0242026.03 | 7.1 | |
| Goedel-Prover-V2-32BModel Category=Open-Weights Prover Models, Self-correction=false2026.03 | 6.7 | |
| Goedel-Prover-V2-32BBudget (b)=UNK2026.03 | 6.7 | |
| DeepSeek-V3.2Model Category=Open-Weights Reasoning Models2026.03 | 5.8 | |
| LongCat-Flash-ProverEvaluation Mode=whole-proof mode, TIR (Tool-Integrated Reasoning)=false2026.03 | 4.9 | |
| Kimina-Prover-8BModel Category=Open-Weights Prover Models2026.03 | 4.8 | |
| Kimina-Prover-72BModel Category=Open-Weights Prover Models2026.03 | 3.9 | |
| Goedel-Prover-V2-8BModel Category=Open-Weights Prover Models, Self-correction=false2026.03 | 3.8 | |
| DeepSeek-Prover-V2-671BModel Category=Open-Weights Prover Models2026.03 | 3.3 | |
| WZ-ProverModel size=8B, Sample budget=pass@322026.05 | 3 | |
| WZ-LLMModel size=8B, Sample budget=pass@322026.05 | 3 | |
| DeepSeek-Prover V2-7BModel size=7B, Sample budget=pass@322026.05 | 2 | |
| WZ-uncoveredModel size=8B, Sample budget=pass@322026.05 | 2 | |
| DeepSeek-Prover-V2-7BModel Category=Open-Weights Prover Models2026.03 | 1.4 | |
| Kimi-K2.5Model Category=Open-Weights Reasoning Models2026.03 | 1.2 | |
| Gemini-3 ProModel Category=Close-Weights Reasoning Models2026.03 | 1.2 | |
| Self-play Theorem ProvingBudget (b)=3,2002026.03 | 1.2 | |
| WZ-Sketch + WZ-ProverModel size=8B, Sample budget=pass@322026.05 | 1 | |
| Kimina-Prover Distill-8BModel size=8B, Sample budget=pass@322026.05 | 0 | |
| Goedel-Prover-V2-8BModel size=8B, Sample budget=pass@322026.05 | 0 | |
| WZ-Sketch + Goedel-Prover-V2Model size=8B, Sample budget=pass@322026.05 | 0 |