PutnamBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PutnamBench
668Solved Count
56
PutnamBench Lean
668Solved Rate
23
PutnamBench (test)
72Accuracy
13
PutnamBench Number Theory
19Solved Problems
13
PutnamBench Lean 4 (full)
668Solved Count
12
PutnamBench September 2025
462Solved Problems Count
11
PutnamBench
62.5Average Proof Length
9
PutnamBench 672 problems
63C@1
8
PutnamBench
17Solved Instances
7
PutnamBench (PB)
0.561Mean Cycle Consistency
6
PutnamBench
163Total Spend
3
PutnamBench Easy Mode
43Solved Problems (Pass@32)
3
PutnamBench 96 problems
4.19Average Score
2
PutnamBench Hard Mode
36Total Solved (Pass@32)
2
PutnamBench 32-problem Lean 4 (random sample)
32Solved Count
1