Malicious Prompt Detection on MM-Vet OOD
3.67FPRVLMShield
Evaluation Results
| Method | Links | |
|---|---|---|
| VLMShieldTarget Model=LLaVA-1.5-13B2026.04 | 3.67 | |
| VLMShieldTarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 3.67 | |
| VLMGuardTarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 3.92 | |
| ASTRATarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 4.2 | |
| VLMGuardTarget Model=LLaVA-1.5-13B2026.04 | 5 | |
| JailGuardTarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 5.62 | |
| ASTRATarget Model=LLaVA-1.5-13B2026.04 | 6.46 | |
| CIDERTarget Model=LLaVA-1.5-13B2026.04 | 6.72 | |
| CIDERTarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 6.72 | |
| ECSOTarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 6.77 | |
| JailGuardTarget Model=LLaVA-1.5-13B2026.04 | 10.55 | |
| MirrorCheckTarget Model=LLaVA-1.5-13B2026.04 | 10.59 | |
| MirrorCheckTarget Model=Qwen2.5-VL-7B-Instruct2026.04 | 10.59 | |
| ECSOTarget Model=LLaVA-1.5-13B2026.04 | 10.96 |