List your company
ResearchFormerly WizWand

Adversarial Attack on NLVR2

67.51Attack Success RateLAMP
17.402830.411443.4256.4286Jan 29, 2026
Updated 8mo ago

Evaluation results

MethodLinks
LAMPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0167.51
LAMPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0167.15
LAMPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0166.64
LAMPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0157.43
LAMPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0153.51
LAMPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0152.74
LAMPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0152.73
UAP-VLPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0152.11
UAP-VLPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0150.15
CPGC-UAPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0149.68
CPGC-UAPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0148.83
CPGC-UAPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0148.74
UAP-VLPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0148.66
UAP-VLPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0133.22
Doubly-UAPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0131.43
Doubly-UAPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0130.55
CPGC-UAPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0129.68
Doubly-UAPTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0129.64
Doubly-UAPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0129.43
Doubly-UAPTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0128.36
Pandora's boxTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0126.55
UAP-VLPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0125.44
Doubly-UAPTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0125.44
UAP-VLPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0124.75
Jailbreak-MLLMTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0124.75
Doubly-UAPTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0123.42
UAP-VLPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0123.11
Jailbreak-MLLMTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0122.53
X-transferTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0122.43
Jailbreak-MLLMTarget Model=VILA-1.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0121.33
Jailbreak-MLLMTarget Model=LLaVa-v1.6, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0121.33
CPGC-UAPTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0120.77
Jailbreak-MLLMTarget Model=Qwen-VL-Chat, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0120.33
CPGC-UAPTarget Model=Mantis-SIGLIP, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0119.88
Jailbreak-MLLMTarget Model=Qwen-2.5, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0119.54
Jailbreak-MLLMTarget Model=Mantis-Idefics2, Evaluation Protocol=Zero-shot Cross-Model Evaluation2026.0119.53
CPGC-UAPTarget Model=Mantis-CLIP, Evaluation Protocol=Standard2026.0119.33