Safety Evaluation on VLBreak (Challenge)
0.04ASRVLGuard
Evaluation Results
| Method | Links | |
|---|---|---|
| VLGuardBackbone=Qwen2-VL2025.08 | 0.04 | |
| PRISMBackbone=Qwen2-VL2025.08 | 0.05 | |
| PRISMBackbone=LLaVA-1.52025.08 | 0.2 | |
| VLGuardBackbone=LLaVA-1.52025.08 | 1.94 | |
| SPA-VLBackbone=LLaVA-1.52025.08 | 6.54 | |
| SPA-VLBackbone=Qwen2-VL2025.08 | 7.82 | |
| SafeRLHF-VBackbone=Qwen2-VL2025.08 | 10.31 | |
| No DefenseBackbone=LLaVA-1.52025.08 | 13 | |
| No DefenseBackbone=Qwen2-VL2025.08 | 15.12 | |
| SafeRLHF-VBackbone=LLaVA-1.52025.08 | 16.44 |