Binary Safety Classification on UnsafeBench
35.5SexualQwen2.5-7B
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-7BModel Category=General Purpose2026.03 | 35.5 | 24.5 | 69.1 | 55.3 | 47.2 | 37.5 | 33.9 | 23.3 | 23 | 41.7 | |
| LLaVA-V1.6-7BModel Category=General Purpose2026.03 | 41.4 | 25.3 | 57 | 57.9 | 72.2 | 52.1 | 54.9 | 66.7 | 6.5 | 52 | |
| Llama GuardModel Category=Safe Guard2026.03 | 44.6 | 0 | 13.2 | 23.5 | 34 | 11.5 | 6.8 | 25 | 0 | 22.7 | |
| QwenGuard-7BModel Category=Safe Guard2026.03 | 51.2 | 26.3 | 50 | 59.6 | 74.2 | 25.2 | 23 | 12.2 | 3.7 | 43.6 | |
| NudeNetModel Category=Traditional Classifier2026.03 | 62.4 | — | — | — | — | — | — | — | — | — | |
| ShieldGemma2Model Category=Safe Guard2026.03 | 72.9 | 24.1 | 57.5 | 15 | 43.9 | 53.2 | 45.2 | 61.3 | 48.4 | 47.3 | |
| NSFW_DetectorModel Category=Traditional Classifier2026.03 | 73.8 | — | — | — | — | — | — | — | — | — | |
| MultiHeadedModel Category=Traditional Classifier2026.03 | 75.7 | 29.2 | 42.6 | — | 74.9 | — | — | 60 | — | — | |
| InstructBLIPModel Category=General Purpose2026.03 | 77.7 | 27 | 61.5 | 33.3 | 69.7 | 68.7 | 50.6 | 66 | 49 | 55.9 | |
| SD_FilterModel Category=Traditional Classifier2026.03 | 78.5 | — | — | — | — | — | — | — | — | — | |
| GLM-4V-9BModel Category=General Purpose2026.03 | 81.9 | 24.9 | 59.2 | 27.9 | 66.7 | 67.7 | 48.1 | 72.5 | 53.5 | 56.5 | |
| SafeGuard-VLModel Category=Safe Guard, Training Stage=SFT2026.03 | 87 | 33.8 | 67 | 45.4 | 74.8 | 72.9 | 61.5 | 76.5 | 53.1 | 67 | |
| SafeGuard-VLModel Category=Safe Guard, Training Stage=Full (RL)2026.03 | 89 | 50.6 | 70.5 | 55.2 | 79 | 62 | 66.7 | 74.9 | 63.3 | 72.2 |