Classification on Hateful Memes (test)
82AccuracySupervised GRPO
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Supervised GRPOCategory=Proposed, Training=Supervised2026.06 | 82 | — | — | — | 0.82 | 0.8 | |
| Self-supervised GRPOCategory=Proposed, Training=Self-supervised2026.06 | 81.8 | — | — | — | 0.81 | 0.79 | |
| Llama MSSetup=FT, Optimization=Multi-stage2025.02 | 79.9 | — | — | — | 0.802 | 0.792 | |
| [43]Category=Prior work2026.06 | 79.9 | — | — | — | 0.8 | 0.79 | |
| [59]Category=Prior work2026.06 | 78.8 | — | — | — | — | — | |
| Gemma-3-12B-ITCategory=Seq. cls. baselines2026.06 | 78 | — | — | — | 0.77 | 0.74 | |
| Qwen3-VL-8B-InstructCategory=Seq. cls. baselines2026.06 | 78 | — | — | — | 0.78 | 0.77 | |
| Burbi et al.2025.02 | 77.7 | — | — | — | — | — | |
| [12]Category=Prior work2026.06 | 77.7 | — | — | — | — | — | |
| [94]Category=Prior work2026.06 | 77.2 | — | — | — | — | — | |
| [89]Category=Prior work2026.06 | 76.4 | — | — | — | — | — | |
| [15]Category=Prior work2026.06 | 73 | — | — | — | — | — | |
| Cao et al.2025.02 | 72.98 | — | — | — | — | — | |
| [42]Category=Prior work2026.06 | 69.5 | — | — | — | — | — | |
| Kiela et al.2025.02 | 69.47 | — | — | — | — | — | |
| CLIPzero-shot=true2024.03 | — | 0.49 | 0.98 | 0.66 | — | — | |
| CuPLzero-shot=true2024.03 | — | 0.5 | 0.87 | 0.64 | — | — | |
| Modeling Collaboratorzero-shot=true2024.03 | — | 0.58 | 0.77 | 0.66 | — | — | |
| PaLI-Xzero-shot=true2024.03 | — | 0.66 | 0.42 | 0.51 | — | — |