Generation on ViDoRe AI Targeted Setting III V1
93ASR-G Sim^-1 (Mean)MO-PGD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=Qwen2.5-3B2025.04 | 93 | 100 | 28 | 0.02 | |
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=SmolVLM2025.04 | 90 | 100 | 27 | 0 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=Qwen2.5-3B2025.04 | 89 | 100 | 26 | 0 | |
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=InternVL3-2B2025.04 | 88 | 100 | 26 | -0.01 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=SmolVLM2025.04 | 79 | 96 | 26 | 0 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=InternVL3-2B2025.04 | 77 | 94 | 26 | -0.01 | |
| Prompt-based (Any)Attack Type=Prompt-based (Any), Embedder=Any, VLM=Any2025.04 | 71 | 91 | 31 | — | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=Qwen2.5-3B2025.04 | 66 | 95 | 27 | 0.01 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=SmolVLM2025.04 | 60 | 65 | 26 | 0 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=InternVL3-2B2025.04 | 57 | 63 | 27 | 0 |