List your company
ResearchFormerly WizWand

Safety Evaluation on MIS (Hard)

7.33Attack Success Rate (ASR)VLGuard
4.470823.770443.0762.3696Aug 26, 2025
Updated 7mo ago

Evaluation results

MethodLinks
VLGuardBackbone=Qwen2-VL2025.087.33
PRISMBackbone=Qwen2-VL2025.0811.29
PRISMBackbone=LLaVA-1.52025.0820
SPA-VLBackbone=LLaVA-1.52025.0823.56
VLGuardBackbone=LLaVA-1.52025.0828.12
SPA-VLBackbone=Qwen2-VL2025.0830.06
SafeRLHF-VBackbone=Qwen2-VL2025.0870.3
SafeRLHF-VBackbone=LLaVA-1.52025.0872.48
No DefenseBackbone=Qwen2-VL2025.0878.02
No DefenseBackbone=LLaVA-1.52025.0878.81