Harmful Meme Detection on Twitter Temporal-Evolving Memes 2025 (Jul~Sep)
82.4F1 ScoreREPMD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| REPMDBase MLLM=Doubao-1.5-V-Pro, Temporal Evaluation Protocol=Fixed (TF)2026.01 | 82.4 | 80 | |
| REPMDBase MLLM=Doubao-1.5-V-Pro, Temporal Evaluation Protocol=Evolving (TE)2026.01 | 82.4 | 80 | |
| Doubao-1.5-V-ProMode=Vanilla2026.01 | 66.2 | 65 | |
| REPMDBase MLLM=GPT-4o, Temporal Evaluation Protocol=Fixed (TF)2026.01 | 63 | 66 | |
| REPMDBase MLLM=GPT-4o, Temporal Evaluation Protocol=Evolving (TE)2026.01 | 61.6 | 65 | |
| GPT-4oMode=Vanilla2026.01 | 56.3 | 55 | |
| RA-HMDTemporal Evaluation Protocol=Fixed (TF)2026.01 | 52.7 | 51.5 | |
| RA-HMDTemporal Evaluation Protocol=Evolving (TE)2026.01 | 40.2 | 40 |