Math Reasoning
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
4.79Accuracy Delta (pp)
4
May 15, 2026
15.83Mean@8
4
May 14, 2026
18.5Mean @8
4
May 14, 2026
28.54Mean@8 Score
4
May 14, 2026
9.27Accuracy
4
May 12, 2026
73.1Accuracy
4
May 8, 2026
63Accuracy
4
May 8, 2026
73.1Accuracy
4
May 8, 2026
83.2Accuracy
4
May 8, 2026
47.2Math Vision Accuracy
4
May 6, 2026
31.7Pass@16
4
Apr 29, 2026
9.5Pass@1
4
Apr 2, 2026
49.06Mean Accuracy
4
Feb 26, 2026
82.45Non-football Accuracy
4
Feb 27, 2026
59.06Accuracy
3
May 28, 2026
34.4Accuracy
3
May 19, 2026
76.58Accuracy
3
May 19, 2026
50Pass@1 Rate
3
Apr 14, 2026
32.08Accuracy
3
Feb 26, 2026
69.4Validation Accuracy
3
Feb 26, 2026
73.3Accuracy
3
Feb 26, 2026
4,025Optimization Token Usage
3
Feb 26, 2026
4,377Optimization Tokens
3
Feb 26, 2026
3,295Optimization-phase Token Usage (thousands)
3
Feb 26, 2026
3,098Token Usage (Optimization Phase, Thousands)
3
Feb 26, 2026