Minerva Math
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Minerva Math
93Accuracy
251
Minerva Math
63.2Accuracy
228
Minerva Math
80.1Accuracy
124
Minerva Math
52.9pass@1 Accuracy
104
Minerva Math v1 (test)
57.4Accuracy (avg@1)
87
Minerva Math
48.5Accuracy (%)
73
Minerva Math
68.4Accuracy
54
Minerva Math
45.2Pass@1 Accuracy
44
Minerva-Math
47.1Avg@1 Accuracy
40
Minerva Math
38.2Pass@1
33
Minerva Math
20.6Minerva Math 4-shot Accuracy
25
Minerva-Math
46.32maj@16
24
Minerva Math
45.2Pass@1
22
Minerva Math
15.524-shot Performance (%)
21
Minerva Math 4-shot
38.4Flexibility (%)
21
Minerva-Math
26.5Accuracy @4
20
Minerva Math
43.9Avg@4
19
Minerva-Math
38.97Accuracy
17
Minerva-Math
49.63Last Score
17
Minerva-Math
57.4Accuracy
16
Minerva Math
39Accuracy (Avg@16)
15
Minerva Math
37.09Avg@k
15
Minerva Math
54.3Average Score (avg@8)
14
Minerva Math
59.74Accuracy
14
Minerva Math
40.1Average Accuracy @16
14