Binary Safety Classification on MindGuard (test)
98.2AUROCMindGuard 8B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MindGuard 8BModel Size=8B2026.02 | 98.2 | 3.1 | 5.4 | |
| MindGuard 4BModel Size=4B2026.02 | 98.1 | 4.1 | 5.5 | |
| Qwen3Guard-Gen-8BModel Size=8B, Configuration=strict2026.02 | 95.3 | 15 | 25.7 | |
| Qwen3Guard-Gen-4BModel Size=4B, Configuration=strict2026.02 | 94.6 | 16.4 | 24.7 | |
| PolyGuard-QwenBackbone=Qwen2026.02 | 93.4 | 21.9 | 32.3 | |
| PolyGuard-MinistralBackbone=Ministral2026.02 | 92.1 | 21.4 | 28.9 | |
| Qwen3Guard-Gen-8BModel Size=8B, Configuration=loose2026.02 | 91.3 | 23.8 | 53.5 | |
| Qwen3Guard-Gen-4BModel Size=4B, Configuration=loose2026.02 | 88.9 | 40.1 | 56.9 | |
| PolyGuard-Qwen-SmolBackbone=Qwen-Smol2026.02 | 83.9 | 50.8 | 53.5 |