Minerva
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Minerva decontaminated
37.1Accuracy
14
Minerva
36.5Mean@32 Accuracy
14
Minerva
44.84pass@4
14
Minerva
19.5Pass@2
14
Minerva
17.66Accuracy
14
Minerva
39.4Average Score @32
14
Minerva
0.494PAQ
14
Minerva
31.66Accuracy
13
Minerva
12.22Average Score @8
13
Minerva
11.76Avg@8
13
Minerva
31.25Pass@1 Accuracy
12
Minerva
50.4Accuracy
12
Minerva
49.5Average Score
12
Minerva
40.81Avg@8
12
Minerva
26Acc@16
12
Minerva
31.76Pass@1 Success Rate
12
Minerva
40.8Accuracy
11
Minerva
49.03Pass@4
10
Minerva
36.76Acc@1
10
Minerva
29.78Exact Match Accuracy
10
Minerva
66.2AVG Score
9
MINERVA
39.3Coverage
9
MINERVA
65.6Accuracy
9
Minerva 272 samples
17.11Accuracy
8
Minerva
56.57Avg@32
8