Meme Classification on Harm-P
91.6AccuracyQwen2-VL-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2-VL-7BEvaluation Protocol=RA-HMD2025.02 | 91.6 | 91.1 | |
| ExplainHM2025.02 | 90.7 | 90.7 | |
| RGCLTraining=Supervised fine-tuned2025.02 | 89.9 | 89.5 | |
| LLaVA-1.5-7BEvaluation Protocol=RA-HMD2025.02 | 89.6 | 89.3 | |
| Qwen2-VL-2BEvaluation Protocol=RA-HMD2025.02 | 88.9 | 88.7 | |
| HateCLIPperTraining=Supervised fine-tuned2025.02 | 87.6 | 86.9 | |
| Qwen2-VL-7BEvaluation Protocol=SFT2025.02 | 85.9 | 86.3 | |
| LLaVA-1.5-7BEvaluation Protocol=SFT2025.02 | 82.8 | 82.8 | |
| CLIPTraining=Supervised fine-tuned2025.02 | 80.6 | 80.3 | |
| Qwen2-VL-2BEvaluation Protocol=SFT2025.02 | 80.3 | 79.7 | |
| RA-HMDbackbone=Qwen2-VL-2B, fine-tuning set=HatefulMemes, protocol=RKC2025.02 | 72.3 | 63.4 | |
| RA-HMDbackbone=LLaVA-1.5-7B, fine-tuning set=HatefulMemes, protocol=RKC2025.02 | 67.3 | 67.8 | |
| RA-HMDbackbone=Qwen2-VL-7B, fine-tuning set=HatefulMemes, protocol=RKC2025.02 | 64.5 | 66.4 | |
| GPT-4o2025.02 | 63.1 | 64.5 | |
| LLaVA-1.5-7BEvaluation Protocol=zero-shot2025.02 | 61.6 | 46.4 | |
| Qwen2-VL-2Bfine-tuning set=HatefulMemes, protocol=SFT + few-shot2025.02 | 56.9 | 55.5 | |
| RGCLfine-tuning set=HatefulMemes2025.02 | 56.4 | 57.1 | |
| Qwen2-VL-7Bfine-tuning set=HatefulMemes, protocol=SFT + few-shot2025.02 | 56.4 | 64.9 | |
| LLaVA-1.5-7Bfine-tuning set=HatefulMemes, protocol=SFT + few-shot2025.02 | 55.6 | 49.6 | |
| Qwen2-VL-7BEvaluation Protocol=4-shot2025.02 | 55.6 | 65.2 | |
| Qwen2-VL-7BEvaluation Protocol=zero-shot2025.02 | 55.5 | 22.9 | |
| GPT-4omode=low-resourced2025.02 | 55.4 | 55.1 | |
| LLaVA-1.5-7Bfine-tuning set=HatefulMemes, protocol=SFT + zero-shot2025.02 | 55.2 | 28.7 | |
| Qwen2-VL-7Bfine-tuning set=HatefulMemes, protocol=SFT + zero-shot2025.02 | 54.7 | 21.5 | |
| Qwen2-VL-2BEvaluation Protocol=zero-shot2025.02 | 53.9 | 21.8 | |
| Qwen2-VL-2Bfine-tuning set=HatefulMemes, protocol=SFT + zero-shot2025.02 | 53.5 | 20.3 | |
| LLaVA-1.5-7BEvaluation Protocol=4-shot2025.02 | 53.5 | 52.2 | |
| Qwen2-VL-2BEvaluation Protocol=4-shot2025.02 | 53 | 51.6 |