Hateful Meme Classification on HarMeme (test)
87AccuracyHateCLIPper w/ RGCL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HateCLIPper w/ RGCLCategory=Systems based on CLIP, Framework=RGCL2023.11 | 87 | 91.8 | — | |
| MemeCLIP2024.09 | 85 | 92.58 | 83.02 | |
| HateCLIPperCategory=Systems based on CLIP, Note=Reproduced with HateCLIPper's code base2023.11 | 84.8 | 89.7 | — | |
| PromptHateCategory=Systems based on CLIP2023.11 | 84.5 | 90.9 | — | |
| PromptHate2023.10 | 84.47 | 90.96 | — | |
| CLIPModality=Image-Only2023.10 | 83.9 | 91.59 | — | |
| Hate-CLIPper+2023.10 | 83.9 | 91.87 | — | |
| LLaVA (Vicuna-13B)Category=Fine-tuned Large Multimodal Models, Backbone=Vicuna-13B2023.11 | 83.3 | 90.8 | — | |
| CLIPFusion=Sum2023.10 | 81.92 | 91.62 | — | |
| ISSUES2023.10 | 81.64 | 92.83 | — | |
| DisMultiHate2023.10 | 81.24 | 86.39 | — | |
| MOMENTACategory=Systems based on CLIP2023.11 | 80.5 | 86.3 | — | |
| CLIPModality=Text-Only2023.10 | 79.38 | 87 | — | |
| GPT-4zero-shot=true, access_platform=Microsoft Copilot2024.09 | 78 | — | 74.41 | |
| CLIPCategory=Systems based on CLIP2023.11 | 76.7 | 82.6 | — |