Harmful Meme Detection on MemeMind (test)
86.25AccuracyMemeGuard
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MemeGuardCategory=Our Method2025.06 | 86.25 | 83.25 | 85.29 | 84.26 | |
| ISSUECategory=Multi-Modality2025.06 | 82.54 | 83.09 | 74.8 | 78.72 | |
| SFT on MemeMindCategory=Multi-Modality2025.06 | 82.15 | 78.64 | 80.12 | 79.37 | |
| CLIP Image+TextCategory=Multi-Modality2025.06 | 80.81 | 80.81 | 71.06 | 74.26 | |
| CLIP Image-OnlyCategory=Single-Modality2025.06 | 80.25 | 79.47 | 71.74 | 74.2 | |
| MemeCLIPCategory=Multi-Modality2025.06 | 79.18 | 80.48 | 78.98 | 79.72 | |
| Qwen2.5-VL-32BCategory=Multi-Modality, Direct evaluation without fine-tuning=true2025.06 | 78.44 | 81.22 | 63.25 | 71.11 | |
| GLM-4.6V-FlashCategory=Multi-Modality, Direct evaluation without fine-tuning=true2025.06 | 77.99 | 82.14 | 58.02 | 68 | |
| Pro-CapCategory=Multi-Modality2025.06 | 75.58 | 78.09 | 78.76 | 78.44 | |
| CLIP Text-OnlyCategory=Single-Modality2025.06 | 74.14 | 75.54 | 56.92 | 61.2 | |
| VisualBERT_COCOCategory=Multi-Modality2025.06 | 63.21 | 63.95 | 63.48 | 63.72 |