Multimodal Safety on MMDS-R
96.53F1 ScoreLLaVAShield
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaVAShieldCategory=Open-Source Models2026.06 | 96.53 | |
| SingGuard-8BCategory=Our Models2026.06 | 89.63 | |
| SingGuard-2BCategory=Our Models2026.06 | 89.6 | |
| SingGuard-4BCategory=Our Models2026.06 | 87.29 | |
| GPT-5.1Category=Closed-Source Models2026.06 | 77 | |
| Qwen3-VL-235BCategory=Open-Source Models2026.06 | 73.93 | |
| LlavaGuardCategory=Open-Source Models2026.06 | 69.72 | |
| ShieldGemma-2Category=Open-Source Models2026.06 | 68.57 | |
| Gemini3-ProCategory=Closed-Source Models2026.06 | 54.75 | |
| Qwen3-VL-4BCategory=Open-Source Models2026.06 | 47.95 | |
| SafeGuard-VLCategory=Open-Source Models2026.06 | 46.67 | |
| Qwen3-VL-8BCategory=Open-Source Models2026.06 | 38.55 | |
| LlamaGuard4Category=Open-Source Models2026.06 | 35.67 | |
| GuardReasoner-VL-7BCategory=Open-Source Models2026.06 | 23.29 | |
| LlamaGuard3-Vision-11BCategory=Open-Source Models2026.06 | 22.67 |