Image-based Jailbreak on JailbreakV_28K IND
0.19ASRVLMShield
Evaluation Results
| Method | Links | |
|---|---|---|
| VLMShieldBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.04 | 0.19 | |
| VLMShieldBase Model=LLaVA-1.5-13B2026.04 | 0.19 | |
| ASTRABase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=Internal Defense2026.04 | 2.14 | |
| ASTRABase Model=LLaVA-1.5-13B2026.04 | 5.21 | |
| VLMGuardBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=Internal Defense2026.04 | 11.82 | |
| JailGuardBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.04 | 14 | |
| VLMGuardBase Model=LLaVA-1.5-13B2026.04 | 16.37 | |
| MirrorCheckBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.04 | 17.19 | |
| MirrorCheckBase Model=LLaVA-1.5-13B2026.04 | 17.19 | |
| JailGuardBase Model=LLaVA-1.5-13B2026.04 | 22.05 | |
| SelfReminderBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.04 | 34.8 | |
| CIDERBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.04 | 37.2 | |
| CIDERBase Model=LLaVA-1.5-13B2026.04 | 37.2 | |
| ECSOBase Model=LLaVA-1.5-13B2026.04 | 39.68 | |
| ECSOBase VLM=Qwen2.5-VL-7B-Instruct, Defense Category=External Defense2026.04 | 43.06 | |
| SelfReminderBase Model=LLaVA-1.5-13B2026.04 | 80.04 |