Hateful Meme Detection on HatefulMemes
63.5AccuracyFlamingo-9B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Flamingo-9BShots=322023.08 | 63.5 | — | |
| Flamingo-9BShots=42023.08 | 62.7 | — | |
| Flamingo-9BShots=02023.08 | 57 | — | |
| Flamingo-3BShots=322023.08 | 56.3 | — | |
| OpenFlamingo-4B (Instruct)Shots=42023.08 | 54.9 | — | |
| OpenFlamingo-4B (Instruct)Shots=322023.08 | 54.9 | — | |
| LLaVAEvaluation Protocol=Zero-shot, Backbone=Vicuna 13B2023.11 | 54.8 | 57.9 | |
| LLaVAEvaluation Protocol=Fine-tuned, Backbone=Vicuna 13B, Training Dataset=HarMeme2023.11 | 54.3 | 56.3 | |
| OpenFlamingo-9BShots=42023.08 | 54 | — | |
| OpenFlamingo-9BShots=322023.08 | 53.8 | — | |
| Flamingo-3BShots=02023.08 | 53.7 | — | |
| Flamingo-3BShots=42023.08 | 53.6 | — | |
| OpenFlamingo-4B (Instruct)Shots=02023.08 | 53.1 | — | |
| OpenFlamingo-4BShots=02023.08 | 52.3 | — | |
| OpenFlamingo-4BShots=322023.08 | 52.2 | — | |
| OpenFlamingo-9BShots=02023.08 | 51.6 | — | |
| OpenFlamingo-4BShots=42023.08 | 51.5 | — | |
| OpenFlamingo-3BShots=02023.08 | 51.2 | — | |
| OpenFlamingo-3BShots=42023.08 | 50.6 | — | |
| OpenFlamingo-3BShots=322023.08 | 50.2 | — | |
| OpenFlamingo-3B (Instruct)Shots=02023.08 | 50.1 | — | |
| OpenFlamingo-3B (Instruct)Shots=42023.08 | 49.5 | — | |
| OpenFlamingo-3B (Instruct)Shots=322023.08 | 47.8 | — | |
| FlamingoEvaluation Protocol=Zero-shot, Model Size=80B2023.11 | — | 46.4 | |
| InstructBLIPEvaluation Protocol=Zero-shot, Backbone=Flan-T5 11B2023.11 | — | 54.1 | |
| InstructBLIPEvaluation Protocol=Zero-shot, Backbone=Vicuna 13B2023.11 | — | 57.5 | |
| LensEvaluation Protocol=Zero-shot, Backbone=Flan-T5 11B2023.11 | — | 59.4 |