Hateful Memes
Benchmarks
TaskDatasetSOTA resultTrendResults
Hateful Memes (test)
0.828AUROC
67
Hateful Memes
0.892ROC AUC
29
Hateful Memes (val)
81.56AUROC
22
Hateful Memes
64.6Overall Score
17
Hateful Memes (val test)
51.05Accuracy
15
Hateful Memes (test)
82Accuracy
15
Hateful Memes
82.3Accuracy
12
Hateful Memes
66Accuracy
11
Hateful Memes (HM) (test)
62.33MiniGPT-4 Score
10
Hateful Memes (test)
69.8Accuracy
8
Hateful Memes Synergy
48.9Accuracy
8
Hateful Memes seen (test)
89.2AUC-ROC
7
Hateful Memes (dev)
78ROC AUC
4
Hateful Memes (test)
78BS
3
Hateful-Memes (HM) (val)
69.85Accuracy
2
Hateful Memes
0.78Bias Score
2