Meme Detection on Meme Detection
71Hatefulness AccuracyQuery-Retrieve-Conclude
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Query-Retrieve-ConcludeModel backbone=Gemma3-12B, Framework=Proposed, Evaluation protocol=Zero-shot2026.06 | 71 | 70 | 80 | 79 | 67 | 67 | 69 | 68 | 70 | 70 | 71 | 71 | |
| Zero-shot Generated BKSModel backbone=Gemma3-12B, BKS condition=With Zero-shot Generated BKS, Evaluation protocol=Zero-shot2026.06 | 69 | 66 | 75 | 74 | 66 | 64 | 65 | 64 | 67 | 66 | 68 | 67 | |
| VanillaModel backbone=Gemma3-12B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 67 | 67 | 73 | 72 | 62 | 61 | 63 | 62 | 65 | 64 | 67 | 65 | |
| MemeAgentModel backbone=Gemma3-12B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 66 | 63 | 61 | 49 | 60 | 56 | 61 | 65 | 62 | 58 | 62 | 59 | |
| MiNDModel backbone=Gemma3-12B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 66 | 65 | 70 | 68 | 61 | 59 | 62 | 61 | 64 | 62 | 65 | 63 | |
| Query-Retrieve-ConcludeModel backbone=Qwen3-VL-8B, Framework=Proposed, Evaluation protocol=Zero-shot2026.06 | 66 | 62 | 67 | 64 | 64 | 62 | 65 | 62 | 66 | 61 | 66 | 62 | |
| Zero-shot Generated BKSModel backbone=Qwen3-VL-8B, BKS condition=With Zero-shot Generated BKS, Evaluation protocol=Zero-shot2026.06 | 65 | 60 | 65 | 61 | 62 | 61 | 63 | 63 | 65 | 60 | 64 | 61 | |
| MemeAgentModel backbone=Qwen3-VL-8B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 64 | 60 | 67 | 65 | 62 | 41 | 64 | 60 | 62 | 59 | 64 | 57 | |
| VanillaModel backbone=Qwen3-VL-8B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 63 | 61 | 64 | 62 | 60 | 59 | 61 | 60 | 63 | 61 | 62 | 61 | |
| MiNDModel backbone=Qwen3-VL-8B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 63 | 60 | 68 | 64 | 61 | 58 | 63 | 59 | 64 | 60 | 64 | 57 | |
| Query-Retrieve-ConcludeModel backbone=LLaVA-1.5-7B, Framework=Proposed, Evaluation protocol=Zero-shot2026.06 | 61 | 59 | 63 | 60 | 62 | 61 | 62 | 59 | 64 | 60 | 62 | 60 | |
| Zero-shot Generated BKSModel backbone=LLaVA-1.5-7B, BKS condition=With Zero-shot Generated BKS, Evaluation protocol=Zero-shot2026.06 | 56 | 42 | 61 | 55 | 62 | 60 | 61 | 56 | 63 | 55 | 61 | 54 | |
| MemeAgentModel backbone=LLaVA-1.5-7B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 55 | 43 | 60 | 45 | 60 | 45 | 56 | 42 | 58 | 46 | 58 | 44 | |
| VanillaModel backbone=LLaVA-1.5-7B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 54 | 45 | 59 | 52 | 58 | 57 | 50 | 34 | 61 | 54 | 56 | 48 | |
| MiNDModel backbone=LLaVA-1.5-7B, BKS condition=Zero-shot without BKS, Evaluation protocol=Zero-shot2026.06 | 54 | 60 | 57 | 50 | 59 | 56 | 55 | 47 | 60 | 53 | 58 | 44 |