Adversarial Attack on Q-Bench
87.23Attack Success RateLAMP
Evaluation results
| Method | Links | |
|---|---|---|
| LAMPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 87.23 | |
| LAMPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 77.56 | |
| LAMPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 77.55 | |
| LAMPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 76.12 | |
| LAMPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 71.45 | |
| LAMPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 71.42 | |
| LAMPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 70.55 | |
| UAP-VLPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 65.33 | |
| UAP-VLPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 63.29 | |
| UAP-VLPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 60.23 | |
| CPGC-UAPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 60.09 | |
| CPGC-UAPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 59.74 | |
| CPGC-UAPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 58.41 | |
| UAP-VLPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 50.1 | |
| CPGC-UAPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 49.09 | |
| Pandora's boxTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 46.64 | |
| Doubly-UAPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 44.76 | |
| UAP-VLPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 43.66 | |
| Jailbreak-MLLMTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 43.66 | |
| Doubly-UAPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 43.64 | |
| Jailbreak-MLLMTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 42.64 | |
| UAP-VLPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 42.55 | |
| Doubly-UAPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 42.53 | |
| Doubly-UAPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 41.35 | |
| X-transferTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 40.87 | |
| Doubly-UAPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 40.51 | |
| Doubly-UAPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 40.43 | |
| Jailbreak-MLLMTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 40.41 | |
| CPGC-UAPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 39.33 | |
| CPGC-UAPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 38.77 | |
| Jailbreak-MLLMTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 38.43 | |
| Jailbreak-MLLMTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 38.43 | |
| Doubly-UAPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 38.13 | |
| UAP-VLPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 34.66 | |
| Jailbreak-MLLMTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 33.34 | |
| CPGC-UAPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 31.33 | |
| Jailbreak-MLLMTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 30.43 |