Multimodal Safety on MMDS-Q
99.13F1 ScoreLLaVAShield
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaVAShieldCategory=Open-Source Models2026.06 | 99.13 | |
| SingGuard-8BCategory=Our Models2026.06 | 98.51 | |
| SingGuard-2BCategory=Our Models2026.06 | 96.97 | |
| SingGuard-4BCategory=Our Models2026.06 | 96.05 | |
| GPT-5.1Category=Closed-Source Models2026.06 | 80.28 | |
| Qwen3-VL-235BCategory=Open-Source Models2026.06 | 72 | |
| LlavaGuardCategory=Open-Source Models2026.06 | 68 | |
| Gemini3-ProCategory=Closed-Source Models2026.06 | 67.19 | |
| ShieldGemma-2Category=Open-Source Models2026.06 | 64.42 | |
| Qwen3-VL-8BCategory=Open-Source Models2026.06 | 57.74 | |
| GuardReasoner-VL-7BCategory=Open-Source Models2026.06 | 56.54 | |
| LlamaGuard3-Vision-11BCategory=Open-Source Models2026.06 | 55.46 | |
| SafeGuard-VLCategory=Open-Source Models2026.06 | 47.56 | |
| Qwen3-VL-4BCategory=Open-Source Models2026.06 | 45.45 | |
| LlamaGuard4Category=Open-Source Models2026.06 | 37.32 |