MAMI
Benchmarks
TaskDatasetSOTA resultTrendResults
MAMI (test)
84.86Accuracy
51
MAMI
85.5Accuracy
33
MAMI
0.799Accuracy
30
MAMI
82.3F1 (Binary)
17
MAMI
89.1Accuracy
16
MAMI
0.395rgL
10
MAMI
0.238rgL
10
MAMI 1.0 (test)
83.77AUC
9
MAMI Task B
79.6Macro-F1
7
MAMI
80.1Accuracy
6
MAMI (test)
7.61Faithfulness
2