Math problem solving
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
68.32Accuracy
50
Jun 23, 2026
70.6Accuracy
44
May 20, 2026
15,521Mean Peak GPU Memory (MB)
41
Jun 26, 2026
90Accuracy
37
Jun 23, 2026
50.6Pass@1 Accuracy
36
Mar 31, 2026
90.22Solve Rate
27
Feb 26, 2026
24.8College Math Acc
26
Feb 26, 2026
79.2Pass@1
22
May 7, 2026
27.1Accuracy (Ar)
20
May 22, 2026
7.71AIME24 Score
18
Feb 26, 2026
91.5Accuracy
17
May 11, 2026
76.4Accuracy
14
Feb 26, 2026
72.6Accuracy
10
Apr 16, 2026
30Accuracy
9
Apr 20, 2026
90.98Accuracy
9
Apr 20, 2026
100AIME 24 Score
4
Apr 21, 2026
32.22GSM8k Accuracy
4
Feb 26, 2026