Text Query Safety on HarmBench
94.85F1 ScoreSingGuard-8B
Evaluation results
| Method | Links | |
|---|---|---|
| SingGuard-8BParameters=8B2026.06 | 94.85 | |
| YuFeng-XGuard-Reason-8B2026.06 | 94.66 | |
| SingGuard-4BParameters=4B2026.06 | 94.66 | |
| SingGuard-2BParameters=2B2026.06 | 94.2 | |
| GPT-5.12026.06 | 93.92 | |
| Qwen3Guard-8BPolicy=strict2026.06 | 93.26 | |
| WildGuard2026.06 | 92.88 | |
| GuardReasoner-VL-7B2026.06 | 92.11 | |
| GuardReasoner-VL-7BAccess=Open-Source2026.06 | 91.36 | |
| GraniteGuardian2026.06 | 90.45 | |
| SingGuard-4BAccess=Open-Source2026.06 | 90.32 | |
| Qwen3-VL-235BAccess=Open-Source2026.06 | 90.18 | |
| SingGuard-2BAccess=Open-Source2026.06 | 90.14 | |
| Qwen3Guard-8B-strictAccess=Open-Source, Configuration=strict2026.06 | 89.07 | |
| SingGuard-8BAccess=Open-Source2026.06 | 88.92 | |
| Qwen3Guard-8B-looseAccess=Open-Source, Configuration=loose2026.06 | 88.16 | |
| YuFeng-XGuard-Reason-8BAccess=Open-Source2026.06 | 86.72 | |
| Llama Guard 3Access=Open-Source2026.06 | 86.68 | |
| Gemini3-Pro2026.06 | 86.15 | |
| Llama Guard 32026.06 | 85.44 | |
| Qwen3Guard-8BPolicy=loose2026.06 | 84.01 | |
| GPT-5.1Access=Closed-Source2026.06 | 78.12 | |
| Qwen3-VL-235B2026.06 | 76.64 | |
| Gemini3-ProAccess=Closed-Source2026.06 | 76.32 | |
| WildGuardAccess=Open-Source2026.06 | 69.76 | |
| GraniteGuardianAccess=Open-Source2026.06 | 66.67 | |
| ShieldGemma-9BAccess=Open-Source2026.06 | 64.63 | |
| ShieldGemma-9B2026.06 | 64.41 |