Automated Formal Theorem Proving on Putnam 2025
1,220Average ScoreHilbert
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HilbertMetric Category=Proof Length (#Lines)2026.03 | 1,220 | — | — | — | — | — | — | — | — | — | — | — | — | 1,220 | — | — | — | |
| SeedMetric Category=Proof Length (#Lines)2026.03 | 1,161 | — | — | — | — | 631 | 469 | 927 | 1,095 | — | 881 | 849 | 1,613 | 584 | 628 | 2,499 | 2,594 | |
| AxiomMetric Category=Proof Length (#Lines)2026.03 | 763 | — | — | — | — | 556 | 458 | 1,089 | 825 | 1,878 | 468 | 1,179 | 346 | 302 | 993 | 1,310 | 862 | |
| NuminaMetric Category=Proof Length (#Lines)2026.03 | 667 | — | — | — | — | 365 | 401 | 422 | 605 | 3,263 | 835 | 328 | 690 | 292 | 648 | 929 | 1,820 | |
| MechanicMetric Category=Proof Length (#Lines)2026.03 | 656 | — | — | — | — | 112 | 798 | 560 | 793 | — | 280 | 1,425 | 224 | 627 | 568 | 1,256 | 578 | |
| HilbertMetric Category=Time Expenditure (min)2026.03 | 228 | — | — | — | — | — | — | — | — | — | — | — | — | 228 | — | — | — | |
| SeedMetric Category=Time Expenditure (min)2026.03 | 196 | — | — | — | — | 60 | 30 | 120 | 240 | — | 240 | 540 | 360 | 30 | 120 | 240 | 180 | |
| AxiomMetric Category=Time Expenditure (min)2026.03 | 187 | — | — | — | — | 110 | 180 | 165 | 107 | 518 | 259 | 270 | 65 | 43 | 112 | 254 | 494 | |
| NuminaMetric Category=Time Expenditure (min)2026.03 | 165 | — | — | — | — | 27 | 81 | 30 | 169 | 2,040 | 89 | 55 | 136 | 30 | 308 | 88 | 797 | |
| MechanicMetric Category=Time Expenditure (min)2026.03 | 114 | — | — | — | — | 21 | 179 | 108 | 64 | — | 82 | 132 | 41 | 148 | 126 | 258 | 93 | |
| NuminaMetric Category=Cost ($)2026.03 | 72.7 | — | — | — | — | 50 | 50 | 50 | 50 | 1,000 | 50 | 50 | 50 | 50 | 50 | 50 | 300 | |
| SeedMetric Category=Proof Tree Complexity (#Lemmas)2026.03 | 49 | — | — | — | — | 27 | 18 | 23 | 28 | — | 38 | 21 | 48 | 26 | 18 | 103 | 185 | |
| HilbertMetric Category=Proof Tree Complexity (#Lemmas)2026.03 | 48 | — | — | — | — | — | — | — | — | — | — | — | — | 48 | — | — | — | |
| HilbertMetric Category=Cost ($)2026.03 | 37.9 | — | — | — | — | — | — | — | — | — | — | — | — | 37.9 | — | — | — | |
| AxiomMetric Category=Proof Tree Complexity (#Lemmas)2026.03 | 36 | — | — | — | — | 23 | 26 | 78 | 32 | 52 | 28 | 49 | 28 | 11 | 23 | 66 | 30 | |
| MechanicMetric Category=Cost ($)2026.03 | 18.5 | — | — | — | — | 4.21 | 29 | 19.5 | 10.5 | — | 4.91 | 29.8 | 3.72 | 15.4 | 20.1 | 57 | 9.01 | |
| NuminaMetric Category=Proof Tree Complexity (#Lemmas)2026.03 | 17 | — | — | — | — | 1 | 5 | 21 | 11 | 77 | 37 | 6 | 14 | 9 | 10 | 33 | 41 | |
| MechanicMetric Category=Proof Tree Complexity (#Lemmas)2026.03 | 14 | — | — | — | — | 1 | 20 | 9 | 10 | — | 1 | 30 | 2 | 9 | 17 | 45 | 10 | |
| STAR-PólyaMathBackbone=all GPT-5.5xh2026.05 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-5.5Reasoning Effort=xhigh2026.05 | 0.8958 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 3.1 Pro2026.05 | 0.8854 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-5.4Reasoning Effort=xhigh2026.05 | 0.8333 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Claude Opus 4.7Reasoning Effort=xhigh2026.05 | 0.7708 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-5.2Reasoning Effort=high2026.05 | 0.7604 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 3 Pro2026.05 | 0.7583 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Claude Opus 4.6Reasoning Effort=high2026.05 | 0.6458 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeepSeek-v3.2-Speciale2026.05 | 0.5917 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Kimi K2.5Reasoning Effort=Think2026.05 | 0.4972 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |