Hate Speech Analysis on HatefulMemes
81.1Binary F1ExPO-HM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ExPO-HMSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 81.1 | 75.6 | 77.2 | 6.2 | 3 | |
| RA-HMDSystem Category=Direct Detection Baselines2025.10 | 80.2 | — | — | 5.5 | — | |
| SFTSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-7B2025.10 | 75 | 64.7 | 71.1 | — | — | |
| ExPO-HMSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 74.7 | 71.5 | 73.7 | 5.1 | 16 | |
| SFTSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 74.5 | 58.4 | 69.4 | 5 | 33 | |
| GRPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 74.5 | 61.2 | 64.5 | 5.2 | 26 | |
| DPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 73.6 | 63.2 | 66.6 | 4.9 | 32 | |
| U-CoT+ (14B)System Category=Explain-then-Detect Systems2025.10 | 72.4 | — | — | — | — | |
| SFTSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-3B2025.10 | 71.9 | 64.3 | 69.3 | — | — | |
| Zero-shotSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-7B2025.10 | 65.9 | 44.7 | 64.5 | 5 | 33 | |
| LOREHM (34B)System Category=Explain-then-Detect Systems2025.10 | 65.6 | — | — | — | — | |
| GRPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 63.4 | 55.6 | 66.1 | 3.8 | 32 | |
| SFTSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 62.3 | 62.7 | 63.3 | 3.6 | 40 | |
| Zero-shotSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-7B2025.10 | 59.8 | 50.3 | 60.2 | — | — | |
| DPOSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 59.6 | 52.3 | 58.1 | 3.5 | 42 | |
| Zero-shotSystem Category=Direct Detection Baselines, Backbone=Qwen2.5-VL-3B2025.10 | 53.1 | 42.1 | 60.1 | — | — | |
| Zero-shotSystem Category=Explain-then-Detect Systems, Backbone=Qwen2.5-VL-3B2025.10 | 52.5 | 41.7 | 58.7 | 3.3 | 42 |