Minerva
Benchmarks
TaskDatasetSOTA resultTrendResults
Minerva
74.8Pass@1 Accuracy
289
Minerva
89.16Accuracy (Acc)
146
Minerva
55.96Pass@1
138
Minerva
68.1Pass@1
80
Minerva
52.9Pass@1
78
Minerva
53.3Accuracy (%)
67
Minerva
54.9Accuracy (@avg1)
57
Minerva
46.6pass@1 Mean
54
Minerva
54.53Pass@1 Accuracy
52
Minerva Math
32.63Pass@1 Accuracy
51
MINERVA
41.54Pass@1
46
Minerva (test)
45Acc
46
Minerva
40.9Avg@16
43
Minerva Math
30.43Average@16
42
Minerva
46.78Avg@16
42
Minerva
89.16Accuracy
40
Minerva
39.7pass@1
32
Minerva
41.7Pass@1 (Avg@16)
32
Minerva
54.53Accuracy
30
Minerva 272
42.53Accuracy (Minerva 272)
28
Minerva
38Mean@8
25
Minerva
51.47Accuracy
25
Minerva
43.8Mean@16
24
MINERVA
37.5Pass@k
24
MINERVA
38.4Pass@k
24