Hateful Meme Detection on FBHM (test)
78.42AccuracyQwen-3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen-3Variant=MAMI-Sft, Setup=+ LSV2026.05 | 78.42 | 75.44 | |
| Qwen-3Variant=FHM-Sft, Setup=+ LSV2026.05 | 77.82 | 74.46 | |
| PixtralVariant=MAMI-Sft, Setup=+ LSV2026.05 | 76.18 | 71.59 | |
| Qwen-3Variant=Base, Setup=+ LSV2026.05 | 76.09 | 72.78 | |
| InternVL-3.5Variant=Base, Setup=+ LSV2026.05 | 70.04 | 52.48 | |
| InternVL-3.5Variant=FHM-Sft, Setup=+ LSV2026.05 | 69.8 | 56.55 | |
| PixtralVariant=FHM-Sft, Setup=+ LSV2026.05 | 68.36 | 58.79 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=+ LSV2026.05 | 67.89 | 51.89 | |
| PixtralVariant=MAMI-Sft, Setup=Base2026.05 | 66.31 | 42.77 | |
| PixtralVariant=Base, Setup=+ PEFT2026.05 | 66.27 | 41.54 | |
| PixtralVariant=MAMI-Sft, Setup=+ PEFT2026.05 | 66.27 | 41.32 | |
| PixtralVariant=FHM-Sft, Setup=+ PEFT2026.05 | 66.24 | 41.25 | |
| PixtralVariant=FHM-Sft, Setup=Base2026.05 | 65.84 | 41.38 | |
| PixtralVariant=Base, Setup=Base2026.05 | 65.38 | 41.53 | |
| GPT-4.1-miniVariant=in-context, Setup=+ ICL2026.05 | 63.24 | 55.17 | |
| PixtralVariant=Base, Setup=+ LSV2026.05 | 63.21 | 58.08 | |
| PixtralVariant=MAMI-Sft, Setup=+ ICL2026.05 | 62.1 | 47.95 | |
| PixtralVariant=FHM-Sft, Setup=+ ICL2026.05 | 61.75 | 46.35 | |
| PixtralVariant=Base, Setup=+ ICL2026.05 | 61 | 43.57 | |
| GPT-5-miniVariant=in-context, Setup=+ ICL2026.05 | 60.64 | 52.73 | |
| GPT-5-miniVariant=zero-shot, Setup=Base2026.05 | 58.38 | 50.23 | |
| InternVL-3.5Variant=FHM-Sft, Setup=+ ICL2026.05 | 57.8 | 49.79 | |
| U-CoT+Variant=pre-trained, Setup=prompting2026.05 | 57.76 | 48.41 | |
| InternVL-3.5Variant=FHM-Sft, Setup=Base2026.05 | 57.29 | 45.37 | |
| InternVL-3.5Variant=Base, Setup=Base2026.05 | 56.69 | 46.84 | |
| GPT-4.1-miniVariant=zero-shot, Setup=Base2026.05 | 56.62 | 52.39 | |
| Qwen-3Variant=MAMI-Sft, Setup=+ ICL2026.05 | 56.58 | 49.64 | |
| InternVL-3.5Variant=FHM-Sft, Setup=+ PEFT2026.05 | 56.47 | 45.14 | |
| InternVL-3.5Variant=Base, Setup=+ PEFT2026.05 | 56.31 | 44.95 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=+ PEFT2026.05 | 56.31 | 44.94 | |
| Qwen-3Variant=Base, Setup=+ ICL2026.05 | 56.22 | 48.65 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=+ ICL2026.05 | 56.02 | 50.58 | |
| InternVL-3.5Variant=Base, Setup=+ ICL2026.05 | 55.98 | 48.62 | |
| Qwen-3Variant=MAMI-Sft, Setup=Base2026.05 | 55.27 | 46.78 | |
| Qwen-3Variant=FHM-Sft, Setup=Base2026.05 | 54.8 | 45.53 | |
| Qwen-3Variant=Base, Setup=BASE2026.05 | 54.78 | 45.99 | |
| Qwen-3Variant=MAMI-Sft, Setup=+ PEFT2026.05 | 54.78 | 46.73 | |
| Qwen-3Variant=FHM-Sft, Setup=+ PEFT2026.05 | 54.47 | 46.34 | |
| Qwen-3Variant=Base, Setup=+ PEFT2026.05 | 54.22 | 46.64 | |
| Qwen-3Variant=FHM-Sft, Setup=+ ICL2026.05 | 53.22 | 49.11 | |
| InternVL-3.5Variant=MAMI-Sft, Setup=Base2026.05 | 50 | 46.06 |