Meme Classification on MultiOFF
71.1AccuracyQwen2-VL-7B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen2-VL-7BEvaluation Protocol=RA-HMD2025.02 | 71.1 | 64.8 | |
| LLaVA-1.5-7BEvaluation Protocol=RA-HMD2025.02 | 70.9 | 63.6 | |
| Qwen2-VL-2BEvaluation Protocol=RA-HMD2025.02 | 68.5 | 61.8 | |
| LLaVA-1.5-7BEvaluation Protocol=SFT2025.02 | 67.8 | 57.8 | |
| Qwen2-VL-7BEvaluation Protocol=SFT2025.02 | 67.8 | 55.5 | |
| RGCL2025.02 | 67.1 | 58.1 | |
| Qwen2-VL-2BEvaluation Protocol=4-shot2025.02 | 67.1 | 44.9 | |
| Qwen2-VL-2BEvaluation Protocol=SFT2025.02 | 66.4 | 54.5 | |
| RA-HMDbackbone=Qwen2-VL-2B, fine-tuning set=HatefulMemes, protocol=RKC2025.02 | 66 | 63.4 | |
| Qwen2-VL-7BEvaluation Protocol=4-shot2025.02 | 64.4 | 54.7 | |
| RA-HMDbackbone=Qwen2-VL-7B, fine-tuning set=HatefulMemes, protocol=RKC2025.02 | 63.8 | 55.6 | |
| Qwen2-VL-7BEvaluation Protocol=zero-shot2025.02 | 63.4 | 35.9 | |
| Qwen2-VL-7Bfine-tuning set=HatefulMemes, protocol=SFT + zero-shot2025.02 | 63.1 | 29.7 | |
| Qwen2-VL-2BEvaluation Protocol=zero-shot2025.02 | 63.1 | 36.3 | |
| LLaVA-1.5-7Bfine-tuning set=HatefulMemes, protocol=SFT + zero-shot2025.02 | 62.8 | 32.5 | |
| RA-HMDbackbone=LLaVA-1.5-7B, fine-tuning set=HatefulMemes, protocol=RKC2025.02 | 62.4 | 51.7 | |
| CLIPTraining=Supervised fine-tuned2025.02 | 62.4 | 48.1 | |
| HateCLIPperTraining=Supervised fine-tuned2025.02 | 62.4 | 54.8 | |
| Qwen2-VL-2Bfine-tuning set=HatefulMemes, protocol=SFT + zero-shot2025.02 | 62.3 | 29.3 | |
| Qwen2-VL-7Bfine-tuning set=HatefulMemes, protocol=SFT + few-shot2025.02 | 62 | 53.7 | |
| GPT-4omode=low-resourced2025.02 | 61.1 | 51.1 | |
| LLaVA-1.5-7BEvaluation Protocol=zero-shot2025.02 | 59.6 | 51.7 | |
| GPT-4o2025.02 | 58.3 | 58.1 | |
| LLaVA-1.5-7Bfine-tuning set=HatefulMemes, protocol=SFT + few-shot2025.02 | 56 | 38.9 | |
| RGCLfine-tuning set=HatefulMemes2025.02 | 53.7 | 45.1 | |
| Qwen2-VL-2Bfine-tuning set=HatefulMemes, protocol=SFT + few-shot2025.02 | 53.7 | 42.4 | |
| LLaVA-1.5-7BEvaluation Protocol=4-shot2025.02 | 38.9 | 56 |