Multimodal Safety (F1) on SPA-VL
78.84Multimodal Safety F1SingGuard-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| SingGuard-8BCategory=Our Models2026.06 | 78.84 | |
| SingGuard-2BCategory=Our Models2026.06 | 77.82 | |
| SingGuard-4BCategory=Our Models2026.06 | 77.6 | |
| GPT-5.1Category=Closed-Source Models2026.06 | 71.79 | |
| Qwen3-VL-235BCategory=Open-Source Models2026.06 | 70.18 | |
| Qwen3-VL-8BCategory=Open-Source Models2026.06 | 70 | |
| GuardReasoner-VL-7BCategory=Open-Source Models2026.06 | 69.84 | |
| Gemini3-ProCategory=Closed-Source Models2026.06 | 66.06 | |
| Qwen3-VL-4BCategory=Open-Source Models2026.06 | 65.05 | |
| SafeGuard-VLCategory=Open-Source Models2026.06 | 61.92 | |
| LLaVAShieldCategory=Open-Source Models2026.06 | 59.17 | |
| LlamaGuard4Category=Open-Source Models2026.06 | 53.13 | |
| ShieldGemma-2Category=Open-Source Models2026.06 | 50.44 | |
| LlamaGuard3-Vision-11BCategory=Open-Source Models2026.06 | 42.72 | |
| LlavaGuardCategory=Open-Source Models2026.06 | 24.55 |