Harm Recognition on Open Images Weapon slice
97.65F1 ScoreSingGuard-4B
Evaluation results
| Method | Links | |
|---|---|---|
| SingGuard-4BSetting=Pixel-only2026.06 | 97.65 | |
| SingGuard-8BSetting=Pixel-only2026.06 | 97.17 | |
| SingGuard-2BSetting=Pixel-only2026.06 | 95.45 | |
| LlavaGuardSetting=Pixel-only2026.06 | 91.62 | |
| GuardReasoner-VLSetting=Pixel-only2026.06 | 90.28 | |
| SafeGuard-VL-RLSetting=Pixel-only2026.06 | 90.19 | |
| LLaVAShieldSetting=Pixel-only2026.06 | 88.41 | |
| Qwen3-VL-235BSetting=Pixel-only2026.06 | 87.48 | |
| Gemini3-ProSetting=Pixel-only2026.06 | 87.2 | |
| GPT-5.1Setting=Pixel-only2026.06 | 86.75 | |
| Qwen3-VL-4BSetting=Pixel-only2026.06 | 85.9 | |
| Qwen3-VL-8BSetting=Pixel-only2026.06 | 83.59 | |
| ShieldGemma-2Setting=Pixel-only2026.06 | 76.27 | |
| LlamaGuard4Setting=Pixel-only2026.06 | 66.34 | |
| LlamaGuard3-VisionSetting=Pixel-only2026.06 | 0.25 |