List your company

Multimodal Safety on MMDS-R

96.53F1 ScoreLLaVAShield
19.715639.657859.679.5422Jun 22, 2026

Evaluation results

MethodLinks
LLaVAShieldCategory=Open-Source Models2026.0696.53
SingGuard-8BCategory=Our Models2026.0689.63
SingGuard-2BCategory=Our Models2026.0689.6
SingGuard-4BCategory=Our Models2026.0687.29
GPT-5.1Category=Closed-Source Models2026.0677
Qwen3-VL-235BCategory=Open-Source Models2026.0673.93
LlavaGuardCategory=Open-Source Models2026.0669.72
ShieldGemma-2Category=Open-Source Models2026.0668.57
Gemini3-ProCategory=Closed-Source Models2026.0654.75
Qwen3-VL-4BCategory=Open-Source Models2026.0647.95
SafeGuard-VLCategory=Open-Source Models2026.0646.67
Qwen3-VL-8BCategory=Open-Source Models2026.0638.55
LlamaGuard4Category=Open-Source Models2026.0635.67
GuardReasoner-VL-7BCategory=Open-Source Models2026.0623.29
LlamaGuard3-Vision-11BCategory=Open-Source Models2026.0622.67