List your company
ResearchFormerly WizWand

Harmful meme detection on FHM (test)

76.2AccuracyQwen-3
51.385657.827864.2770.7122Jan 24, 2024Jun 14, 2024Nov 4, 2024Mar 27, 2025Aug 16, 2025Jan 6, 2026May 29, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Qwen-3Variant=FHM-Sft, Setup=+ LSV2026.0576.275.98
EXPLAINHM2024.0175.675.39
Pro-Cap2024.0174.9571.68
Qwen-3Variant=FHM-Sft, Setup=Base2026.0574.874.05
GPT-5-miniVariant=zero-shot, Setup=Base2026.0574.1573.62
PixtralVariant=FHM-Sft, Setup=+ ICL2026.0573.873.35
U-CoT+Variant=pre-trained, Setup=prompting2026.0573.473.39
InternVL-3.5Variant=FHM-Sft, Setup=Base2026.0573.273.08
MaskPrompt2024.0172.9865.24
Qwen-3Variant=MAMI-Sft, Setup=+ LSV2026.0572.872.8
InternVL-3.5Variant=FHM-Sft, Setup=+ LSV2026.0572.872.57
GPT-5-miniVariant=in-context, Setup=+ ICL2026.0572.872.17
GPT-4.1-miniVariant=in-context, Setup=+ ICL2026.0572.572.47
PixtralVariant=FHM-Sft, Setup=+ LSV2026.0572.471.54
Qwen-3Variant=FHM-Sft, Setup=+ ICL2026.0570.769.14
InternVL-3.5Variant=FHM-Sft, Setup=+ ICL2026.0570.569.81
Qwen-3Variant=MAMI-Sft, Setup=Base2026.0570.470.17
PixtralVariant=MAMI-Sft, Setup=+ ICL2026.0570.269.75
PixtralVariant=MAMI-Sft, Setup=+ LSV2026.0570.270.17
GPT-4.1-miniVariant=zero-shot, Setup=Base2026.0570.269.97
Qwen-3Variant=Base, Setup=+ LSV2026.0569.869.79
InternVL-3.5Variant=MAMI-Sft, Setup=+ LSV2026.0569.669.58
Qwen-3Variant=FHM-Sft, Setup=+ PEFT2026.0568.968.64
Qwen-3Variant=MAMI-Sft, Setup=+ PEFT2026.0568.768.46
Qwen-3Variant=Base, Setup=Base2026.0568.668.33
PixtralVariant=Base, Setup=+ LSV2026.0568.668.55
PixtralVariant=Base, Setup=+ ICL2026.0568.468.09
Qwen-3Variant=Base, Setup=+ PEFT2026.0568.368
Qwen-3Variant=MAMI-Sft, Setup=+ ICL2026.0567.966.71
InternVL-3.5Variant=Base, Setup=+ LSV2026.0567.367.29
Qwen-3Variant=Base, Setup=+ ICL2026.0566.865.84
InternVL-3.5Variant=Base, Setup=+ PEFT2026.0565.665.33
InternVL-3.5Variant=FHM-Sft, Setup=+ PEFT2026.0565.465.1
InternVL-3.5Variant=Base, Setup=Base2026.0565.364.88
InternVL-3.5Variant=MAMI-Sft, Setup=+ PEFT2026.0565.365
InternVL-3.5Variant=MAMI-Sft, Setup=Base2026.0565.263.59
MMBT2024.0165.0661.93
VILBERT CCPre-training dataset=CC2024.0164.755.78
InternVL-3.5Variant=MAMI-Sft, Setup=+ ICL2026.0564.562.94
InternVL-3.5Variant=Base, Setup=+ ICL2026.0563.762.11
VisualBERT COCOPre-training dataset=COCO2024.0161.4847.26
PixtralVariant=Base, Setup=Base2026.0561.458.74
MOMENTA2024.0161.3457.45
PixtralVariant=FHM-Sft, Setup=Base2026.0559.954.34
PixtralVariant=MAMI-Sft, Setup=Base2026.0559.253.87
Late Fusion2024.0159.1444.81
PixtralVariant=Base, Setup=+ PEFT2026.0558.453.18
PixtralVariant=FHM-Sft, Setup=+ PEFT2026.0558.152.59
PixtralVariant=MAMI-Sft, Setup=+ PEFT2026.0557.751.91
Text BERT2024.0157.1241.52
Image-Region2024.0152.3434.19