Text Query Safety on ExpGuard (test)
93.93F1 ScoreSingGuard-8B
Evaluation results
| Method | Links | |
|---|---|---|
| SingGuard-8BAccess=Open-Source2026.06 | 93.93 | |
| SingGuard-4BAccess=Open-Source2026.06 | 93.52 | |
| SingGuard-2BAccess=Open-Source2026.06 | 92.94 | |
| GPT-5.1Access=Closed-Source2026.06 | 91.51 | |
| Qwen3-VL-235BAccess=Open-Source2026.06 | 91.46 | |
| Qwen3Guard-8B-strictAccess=Open-Source, Configuration=strict2026.06 | 91.4 | |
| YuFeng-XGuard-Reason-8BAccess=Open-Source2026.06 | 91.21 | |
| GraniteGuardian2026.06 | 91.15 | |
| WildGuardAccess=Open-Source2026.06 | 89.98 | |
| SingGuard-4BParameters=4B2026.06 | 89.53 | |
| SingGuard-8BParameters=8B2026.06 | 89.4 | |
| Gemini3-ProAccess=Closed-Source2026.06 | 89.21 | |
| SingGuard-2BParameters=2B2026.06 | 88.76 | |
| GraniteGuardianAccess=Open-Source2026.06 | 88.68 | |
| GPT-5.12026.06 | 85.54 | |
| GuardReasoner-VL-7B2026.06 | 84.66 | |
| Qwen3Guard-8B-looseAccess=Open-Source, Configuration=loose2026.06 | 84.55 | |
| WildGuard2026.06 | 84.38 | |
| Llama Guard 3Access=Open-Source2026.06 | 84.19 | |
| YuFeng-XGuard-Reason-8B2026.06 | 83.61 | |
| Qwen3Guard-8BPolicy=strict2026.06 | 82.97 | |
| Gemini3-Pro2026.06 | 79.8 | |
| GuardReasoner-VL-7BAccess=Open-Source2026.06 | 78.55 | |
| Qwen3-VL-235B2026.06 | 78.52 | |
| Llama Guard 32026.06 | 70.77 | |
| Qwen3Guard-8BPolicy=loose2026.06 | 69.53 | |
| ShieldGemma-9B2026.06 | 53.4 | |
| ShieldGemma-9BAccess=Open-Source2026.06 | 40.14 |