Hateful Meme Detection on MAMI
82.3F1 (Binary)ExPO-HM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ExPO-HMSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 82.3 | — | — | 73 | 0.04 | |
| RA-HMDSystem Category=Direct Detection Baselines2025.10 | 81 | — | — | — | — | |
| ExPO-HMSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 80.7 | — | — | 70.4 | 0.08 | |
| U-CoT+ (14B)System Category=Explain-then-Detect Systems2025.10 | 79.9 | — | — | — | — | |
| SFTSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-7B2025.10 | 78.1 | — | — | 63.1 | — | |
| SFTSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-3B2025.10 | 77.9 | — | — | 61.8 | — | |
| GRPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 76.8 | — | — | 63.7 | 0.09 | |
| GRPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 76.6 | — | — | 61.2 | 0.19 | |
| LOREHM (34B)System Category=Explain-then-Detect Systems2025.10 | 75.3 | — | — | — | — | |
| SFTSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 72.8 | — | — | 62.6 | 0.19 | |
| DPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 72.3 | — | — | 56.6 | 0.22 | |
| SFTSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 69.2 | — | — | 60.1 | 0.34 | |
| DPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 66.8 | — | — | 50.2 | 0.36 | |
| Zero-shotSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 63.9 | — | — | 46.5 | 0.23 | |
| Zero-shotSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-7B2025.10 | 63.4 | — | — | 50.2 | — | |
| Zero-shotSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-3B2025.10 | 61.1 | — | — | 48.2 | — | |
| Zero-shotSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 58.7 | — | — | 41.7 | 0.32 | |
| ALBEFAugmented image tags=false2023.08 | — | 0.8324 | 72.77 | — | — | |
| BLIPAugmented image tags=false2023.08 | — | 0.8059 | 71.84 | — | — | |
| CLIP-BERTAugmented image tags=false2023.08 | — | 0.7766 | 68.44 | — | — | |
| DisMultiHateAugmented image tags=false2023.08 | — | 0.7821 | 70.58 | — | — | |
| Image-RegionAugmented image tags=false2023.08 | — | 0.702 | 64.18 | — | — | |
| MMBT-RegionAugmented image tags=false2023.08 | — | 0.7917 | 70.46 | — | — | |
| Pro-CapBERTAugmented image tags=false2023.08 | — | 0.7962 | 71.06 | — | — | |
| Pro-CapPromptHateAugmented image tags=false2023.08 | — | 0.8253 | 73.06 | — | — | |
| PromptHateAugmented image tags=false2023.08 | — | 0.7621 | 68.08 | — | — | |
| Text BERTAugmented image tags=false2023.08 | — | 0.7448 | 67.37 | — | — | |
| VILBERT CCAugmented image tags=false2023.08 | — | 0.7771 | 69.48 | — | — | |
| VisualBERT COCOAugmented image tags=false2023.08 | — | 0.7871 | 71.06 | — | — |