Safety Classification on OS Bench
0.936RecallCLUE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CLUEModel Architecture=LLaVA-v1.6-34B2024.12 | 0.936 | 0.862 | 0.871 | |
| LAION-AI NSFW DetectorModel Architecture=CLIP ViT B/322024.12 | 0.416 | 0.609 | 0.515 | |
| LAION-AI NSFW DetectorModel Architecture=CLIP ViT L/142024.12 | 0.399 | 0.609 | 0.505 | |
| Q16Model Architecture=CLIP ViT B/162024.12 | 0.32 | 0.608 | 0.449 | |
| Q16Model Architecture=CLIP ViT L/142024.12 | 0.297 | 0.625 | 0.441 | |
| Stable Diffusion Safety CheckerModel Architecture=CLIP ViT L/142024.12 | 0.264 | 0.622 | 0.41 | |
| LLaVA GuardPrompt=Default Prompt, Model Architecture=LLaVA-v1.6-34B2024.12 | 0.261 | 0.612 | 0.401 | |
| LLaVA GuardPrompt=Modified Prompt, Model Architecture=LLaVA-v1.6-34B2024.12 | 0.243 | 0.599 | 0.377 |