Response Classification on BeaverTails V Text-Image Response
84.8F1 ScoreQwen3Guard-8B-Gen
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3Guard-8B-GenSafeguard Type=Post-hoc2026.02 | 84.8 | |
| Qwen3Guard-4B-StreamSafeguard Type=Streaming2026.02 | 84.6 | |
| Qwen3Guard-4B-GenSafeguard Type=Post-hoc2026.02 | 84.5 | |
| Qwen3Guard-8B-StreamSafeguard Type=Streaming2026.02 | 84.2 | |
| KelpSafeguard Type=Streaming2026.02 | 84.1 | |
| GuardReasoner-8B2025.12 | 84.02 | |
| Qwen3Guard-0.6B-GenSafeguard Type=Post-hoc2026.02 | 84 | |
| SCM-7BSafeguard Type=Streaming2026.02 | 83.4 | |
| ProGuard-7B2025.12 | 83.1 | |
| WildGuard-7BSafeguard Type=Post-hoc2026.02 | 82.9 | |
| Qwen3Guard-0.6B-StreamSafeguard Type=Streaming2026.02 | 82.7 | |
| GuardReasonerVL-7B2025.12 | 82.35 | |
| DynaGuard-8B2025.12 | 81.73 | |
| NExT-GuardSafeguard Type=Streaming2026.02 | 81.2 | |
| MD-Judge-7B2025.12 | 81.13 | |
| Gemini2.5-Flash2025.12 | 80.72 | |
| NExT-Guard*Safeguard Type=Streaming2026.02 | 80.6 | |
| ProGuard-7B2025.12 | 80.44 | |
| ProGuard-3B2025.12 | 79.83 | |
| ProGuard-3B2025.12 | 79.19 | |
| Gemini2.5-Flash2025.12 | 77.85 | |
| NemoGuard-8BSafeguard Type=Post-hoc2026.02 | 77.4 | |
| LlamaGuard2-8B2025.12 | 74.62 | |
| LlamaGuard4-12B2025.12 | 73.51 | |
| WildGuard-7B2025.12 | 73.39 | |
| GPT4o-mini2025.12 | 72.92 | |
| GPT-OSS-SafeGuard-20B2025.12 | 72.59 | |
| LlamaGuard3-8B2025.12 | 72.4 | |
| LlamaGuard3-11B-Vision2025.12 | 70.91 | |
| LlamaGuard-7B2025.12 | 69.49 | |
| LlamaGuard4-12BSafeguard Type=Post-hoc2026.02 | 67.5 | |
| LlamaGuard3-8BSafeguard Type=Post-hoc2026.02 | 67.3 | |
| ShieldGemma-27BSafeguard Type=Post-hoc2026.02 | 66.8 | |
| LlamaGuard3-11B-Vision2025.12 | 66.62 | |
| GuardReasonerVL-7B2025.12 | 66.13 | |
| GPT4o-mini2025.12 | 63.5 | |
| LlamaGuard4-12B2025.12 | 62.8 | |
| ShieldGemma-9BSafeguard Type=Post-hoc2026.02 | 61.1 | |
| ShieldGemma-9B2025.12 | 57 |