Harmful meme detection on FHM (test)
76.2AccuracyQwen-3
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen-3Variant=FHM-Sft, Setup=+ LSV2026.05 | 76.2 | 75.98 | |
| EXPLAINHM2024.01 | 75.6 | 75.39 | |
| Pro-Cap2024.01 | 74.95 | 71.68 | |
| Qwen-3Variant=FHM-Sft, Setup=Base2026.05 | 74.8 | 74.05 | |
| GPT-5-miniVariant=zero-shot, Setup=Base2026.05 | 74.15 | 73.62 | |
| PixtralVariant=FHM-Sft, Setup=+ ICL2026.05 | 73.8 | 73.35 | |
| U-CoT+Variant=pre-trained, Setup=prompting2026.05 | 73.4 | 73.39 | |
| InternVL-3.5Variant=FHM-Sft, Setup=Base2026.05 | 73.2 | 73.08 | |
| MaskPrompt2024.01 | 72.98 | 65.24 | |
| Qwen-3Variant=MAMI-Sft, Setup=+ LSV2026.05 | 72.8 | 72.8 | |
| InternVL-3.5Variant=FHM-Sft, Setup=+ LSV2026.05 | 72.8 | 72.57 | |
| GPT-5-miniVariant=in-context, Setup=+ ICL2026.05 | 72.8 | 72.17 | |
| GPT-4.1-miniVariant=in-context, Setup=+ ICL2026.05 | 72.5 | 72.47 | |
| PixtralVariant=FHM-Sft, Setup=+ LSV2026.05 | 72.4 | 71.54 | |
| Qwen-3Variant=FHM-Sft, Setup=+ ICL2026.05 | 70.7 | 69.14 | |
| InternVL-3.5Variant=FHM-Sft, Setup=+ ICL2026.05 | 70.5 | 69.81 | |
| Qwen-3Variant=MAMI-Sft, Setup=Base2026.05 | 70.4 | 70.17 | |
| PixtralVariant=MAMI-Sft, Setup=+ ICL2026.05 | 70.2 | 69.75 | |
| PixtralVariant=MAMI-Sft, Setup=+ LSV2026.05 | 70.2 | 70.17 | |
| GPT-4.1-miniVariant=zero-shot, Setup=Base2026.05 | 70.2 | 69.97 | |
| Qwen-3Variant=Base, Setup=+ LSV2026.05 | 69.8 | 69.79 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=+ LSV2026.05 | 69.6 | 69.58 | |
| Qwen-3Variant=FHM-Sft, Setup=+ PEFT2026.05 | 68.9 | 68.64 | |
| Qwen-3Variant=MAMI-Sft, Setup=+ PEFT2026.05 | 68.7 | 68.46 | |
| Qwen-3Variant=Base, Setup=Base2026.05 | 68.6 | 68.33 | |
| PixtralVariant=Base, Setup=+ LSV2026.05 | 68.6 | 68.55 | |
| PixtralVariant=Base, Setup=+ ICL2026.05 | 68.4 | 68.09 | |
| Qwen-3Variant=Base, Setup=+ PEFT2026.05 | 68.3 | 68 | |
| Qwen-3Variant=MAMI-Sft, Setup=+ ICL2026.05 | 67.9 | 66.71 | |
| InternVL-3.5Variant=Base, Setup=+ LSV2026.05 | 67.3 | 67.29 | |
| Qwen-3Variant=Base, Setup=+ ICL2026.05 | 66.8 | 65.84 | |
| InternVL-3.5Variant=Base, Setup=+ PEFT2026.05 | 65.6 | 65.33 | |
| InternVL-3.5Variant=FHM-Sft, Setup=+ PEFT2026.05 | 65.4 | 65.1 | |
| InternVL-3.5Variant=Base, Setup=Base2026.05 | 65.3 | 64.88 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=+ PEFT2026.05 | 65.3 | 65 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=Base2026.05 | 65.2 | 63.59 | |
| MMBT2024.01 | 65.06 | 61.93 | |
| VILBERT CCPre-training dataset=CC2024.01 | 64.7 | 55.78 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=+ ICL2026.05 | 64.5 | 62.94 | |
| InternVL-3.5Variant=Base, Setup=+ ICL2026.05 | 63.7 | 62.11 | |
| VisualBERT COCOPre-training dataset=COCO2024.01 | 61.48 | 47.26 | |
| PixtralVariant=Base, Setup=Base2026.05 | 61.4 | 58.74 | |
| MOMENTA2024.01 | 61.34 | 57.45 | |
| PixtralVariant=FHM-Sft, Setup=Base2026.05 | 59.9 | 54.34 | |
| PixtralVariant=MAMI-Sft, Setup=Base2026.05 | 59.2 | 53.87 | |
| Late Fusion2024.01 | 59.14 | 44.81 | |
| PixtralVariant=Base, Setup=+ PEFT2026.05 | 58.4 | 53.18 | |
| PixtralVariant=FHM-Sft, Setup=+ PEFT2026.05 | 58.1 | 52.59 | |
| PixtralVariant=MAMI-Sft, Setup=+ PEFT2026.05 | 57.7 | 51.91 | |
| Text BERT2024.01 | 57.12 | 41.52 | |
| Image-Region2024.01 | 52.34 | 34.19 |