Adversarial Attack on LVLM Evaluation Set
99.8ASRVT-Attack
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VT-AttackTarget Model=OpenFlamingo2026.02 | 99.8 | — | — | — | — | — | — | |
| Attack-BardTarget Model=OpenFlamingo2026.02 | 97.8 | — | — | — | — | — | — | |
| Cui et al.Target Model=OpenFlamingo2026.02 | 97 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=BLIP-22026.02 | 84.4 | — | — | — | — | — | — | |
| SGMAsetting=model-ensemble (ME)2026.02 | 64 | 0.2228 | 0.4429 | 0.2795 | 0.2762 | 0.2265 | 0.2896 | |
| Schlarmann and HeinTarget Model=OpenFlamingo2026.02 | 59.4 | — | — | — | — | — | — | |
| VT-Attacksetting=model-ensemble (ME)2026.02 | 52.2 | 0.2285 | 0.4488 | 0.287 | 0.283 | 0.2367 | 0.2968 | |
| VT-AttackTarget Model=LLaVA2026.02 | 46 | — | — | — | — | — | — | |
| Cui et al.setting=model-ensemble (ME)2026.02 | 43 | 0.2341 | 0.4556 | 0.2956 | 0.2912 | 0.2487 | 0.305 | |
| Cui et al.Target Model=LLaVA2026.02 | 41.8 | — | — | — | — | — | — | |
| Attack-BardTarget Model=LLaVA2026.02 | 38.4 | — | — | — | — | — | — | |
| Attack-Bardsetting=model-ensemble (ME)2026.02 | 34.2 | 0.2355 | 0.4565 | 0.2959 | 0.2916 | 0.2487 | 0.3057 | |
| VT-AttackTarget Model=InternVL32026.02 | 31.6 | — | — | — | — | — | — | |
| VT-AttackTarget Model=Qwen2.5-VL2026.02 | 31.4 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=LLaVA2026.02 | 28.4 | — | — | — | — | — | — | |
| VT-AttackTarget Model=Kimi-VL2026.02 | 28.2 | — | — | — | — | — | — | |
| VT-AttackTarget Model=BLIP-22026.02 | 27.6 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=Qwen2.5-VL2026.02 | 26.8 | — | — | — | — | — | — | |
| Cui et al.Target Model=BLIP-22026.02 | 26.8 | — | — | — | — | — | — | |
| Attack-BardTarget Model=BLIP-22026.02 | 26 | — | — | — | — | — | — | |
| Attack-BardTarget Model=Qwen2.5-VL2026.02 | 25 | — | — | — | — | — | — | |
| Cui et al.Target Model=InternVL32026.02 | 24.6 | — | — | — | — | — | — | |
| Cui et al.Target Model=Qwen2.5-VL2026.02 | 24.2 | — | — | — | — | — | — | |
| Attack-BardTarget Model=InternVL32026.02 | 24.2 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=Kimi-VL2026.02 | 23.2 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=InternVL32026.02 | 23 | — | — | — | — | — | — | |
| Attack-BardTarget Model=Kimi-VL2026.02 | 23 | — | — | — | — | — | — | |
| Cui et al.Target Model=Kimi-VL2026.02 | 21.8 | — | — | — | — | — | — | |
| SGMAAttack=SGMA2026.02 | 18.9 | — | — | — | — | — | — | |
| VT-AttackTarget Model=GPT-4o2026.02 | 11 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=GPT-4o2026.02 | 8.4 | — | — | — | — | — | — | |
| MF-itAttack=MF-it2026.02 | 7.6 | — | — | — | — | — | — | |
| VT-AttackTarget Model=Gemini 2.02026.02 | 7.6 | — | — | — | — | — | — | |
| Cui et al.Target Model=GPT-4o2026.02 | 7 | — | — | — | — | — | — | |
| Attack-BardTarget Model=GPT-4o2026.02 | 6.9 | — | — | — | — | — | — | |
| Attack-BardTarget Model=Gemini 2.02026.02 | 6.8 | — | — | — | — | — | — | |
| MF-iiAttack=MF-ii2026.02 | 6 | — | — | — | — | — | — | |
| CoAAttack=CoA2026.02 | 6 | — | — | — | — | — | — | |
| Cui et al.Target Model=Gemini 2.02026.02 | 5.6 | — | — | — | — | — | — | |
| Schlarmann and HeinTarget Model=Gemini 2.02026.02 | 5.4 | — | — | — | — | — | — |