Mintaka
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Mintaka
77.4Pass@1
36
Mintaka (val)
100Precision
36
Mintaka
88F1 Score
36
Mintaka refined by question type and domain
75.51AUROC
20
Mintaka refined by question type
77.89AUROC
20
Mintaka
64.2Precision
16
Mintaka (original)
79.41AUROC
10
Mintaka unrefined (original)
79.41AUROC
10
Mintaka
82.7Recall
7
Mintaka
67.6Exact Match (EM)
6