Adversarial Attack on NLVR2
67.51Attack Success RateLAMP
Evaluation Results
| Method | Links | |
|---|---|---|
| LAMPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 67.51 | |
| LAMPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 67.15 | |
| LAMPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 66.64 | |
| LAMPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 57.43 | |
| LAMPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 53.51 | |
| LAMPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 52.74 | |
| LAMPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 52.73 | |
| UAP-VLPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 52.11 | |
| UAP-VLPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 50.15 | |
| CPGC-UAPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 49.68 | |
| CPGC-UAPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 48.83 | |
| CPGC-UAPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 48.74 | |
| UAP-VLPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 48.66 | |
| UAP-VLPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 33.22 | |
| Doubly-UAPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 31.43 | |
| Doubly-UAPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 30.55 | |
| CPGC-UAPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 29.68 | |
| Doubly-UAPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 29.64 | |
| Doubly-UAPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 29.43 | |
| Doubly-UAPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 28.36 | |
| Pandora's boxTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 26.55 | |
| UAP-VLPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 25.44 | |
| Doubly-UAPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 25.44 | |
| UAP-VLPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 24.75 | |
| Jailbreak-MLLMTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 24.75 | |
| Doubly-UAPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 23.42 | |
| UAP-VLPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 23.11 | |
| Jailbreak-MLLMTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 22.53 | |
| X-transferTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 22.43 | |
| Jailbreak-MLLMTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 21.33 | |
| Jailbreak-MLLMTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 21.33 | |
| CPGC-UAPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 20.77 | |
| Jailbreak-MLLMTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 20.33 | |
| CPGC-UAPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 19.88 | |
| Jailbreak-MLLMTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 19.54 | |
| Jailbreak-MLLMTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.01 | 19.53 | |
| CPGC-UAPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.01 | 19.33 |