Multimodal Understanding on CC3M IOD
100AccuracyVLMShield
Evaluation Results
| Method | Links | |
|---|---|---|
| VLMShieldBase VLM=LLaVA-1.5-13B2026.04 | 100 | |
| VLMShieldBase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 100 | |
| JailGuardBase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 98.8 | |
| ASTRABase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 98.46 | |
| VLMGuardBase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 98.2 | |
| ASTRABase VLM=LLaVA-1.5-13B2026.04 | 98.03 | |
| ECSOBase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 97.29 | |
| ECSOBase VLM=LLaVA-1.5-13B2026.04 | 96.77 | |
| CIDERBase VLM=LLaVA-1.5-13B2026.04 | 96.64 | |
| CIDERBase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 96.64 | |
| JailGuardBase VLM=LLaVA-1.5-13B2026.04 | 96.14 | |
| VLMGuardBase VLM=LLaVA-1.5-13B2026.04 | 96 | |
| MirrorCheckBase VLM=LLaVA-1.5-13B2026.04 | 91.32 | |
| MirrorCheckBase VLM=Qwen2.5-VL-7B-Instruct2026.04 | 91.32 |