List your company

Multimodal Safety on BeaverTails V

91.54F1 ScoreShieldGemma-2
32.093647.526862.9678.3932Jun 22, 2026

Evaluation results

MethodLinks
ShieldGemma-2Category=Open-Source Models2026.0691.54
SingGuard-4BCategory=Our Models2026.0683.37
SingGuard-8BCategory=Our Models2026.0683.15
SingGuard-2BCategory=Our Models2026.0680.47
Qwen3-VL-235BCategory=Open-Source Models2026.0679.49
GPT-5.1Category=Closed-Source Models2026.0677.25
Qwen3-VL-4BCategory=Open-Source Models2026.0672.28
Gemini3-ProCategory=Closed-Source Models2026.0667.21
Qwen3-VL-8BCategory=Open-Source Models2026.0665.07
LLaVAShieldCategory=Open-Source Models2026.0664.11
SafeGuard-VLCategory=Open-Source Models2026.0657.16
LlavaGuardCategory=Open-Source Models2026.0655.04
GuardReasoner-VL-7BCategory=Open-Source Models2026.0654.2
LlamaGuard4Category=Open-Source Models2026.0651.79
LlamaGuard3-Vision-11BCategory=Open-Source Models2026.0634.38