List your company
ResearchFormerly WizWand

Direct Malicious on MM-SafetyBench OOD

0.71ASRVLMShield
-1.312412.338825.9939.6412Apr 7, 2026
Updated 6mo ago

Evaluation results

MethodLinks
VLMShieldBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.040.71
VLMShieldBase Model=LLaVA-1.5-13B2026.040.71
ASTRABase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=Internal Defense2026.044.12
ASTRABase Model=LLaVA-1.5-13B2026.048.62
VLMGuardBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=Internal Defense2026.049.05
VLMGuardBase Model=LLaVA-1.5-13B2026.0412.9
ECSOBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.0413.28
SelfReminderBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.0415.2
ECSOBase Model=LLaVA-1.5-13B2026.0418.39
JailGuardBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.0424.35
MirrorCheckBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.0425.08
MirrorCheckBase Model=LLaVA-1.5-13B2026.0425.08
JailGuardBase Model=LLaVA-1.5-13B2026.0436.22
CIDERBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.0446.91
CIDERBase Model=LLaVA-1.5-13B2026.0446.91
SelfReminderBase Model=LLaVA-1.5-13B2026.0451.27