Targeted Poisoning Attack on ViDoRe AI (Targeted Setting II: 5 queries, 1 answer) V1
88ASR @1 (mean)MO-PGD
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=SmolVLM2025.04 | 88 | 92 | 1 | 1 | 15 | 17 | |
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=InternVL3-2B2025.04 | 80 | 80 | 0.83 | 1 | 43 | 45 | |
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=Qwen2.5-3B2025.04 | 80 | 84 | 0.97 | 1 | 18 | 18 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=Qwen2.5-3B2025.04 | 24 | 56 | 1 | 1 | 49 | 50 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=SmolVLM2025.04 | 20 | 56 | 0.29 | 0.97 | 10 | 12 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=InternVL3-2B2025.04 | 20 | 68 | 0.78 | 1 | 57 | 59 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=SmolVLM2025.04 | 20 | 56 | 0.93 | 1 | 16 | 17 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=InternVL3-2B2025.04 | 12 | 72 | -0.02 | 0.11 | 0 | 2 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=Qwen2.5-3B2025.04 | 12 | 64 | 0.46 | 0.79 | 38 | 40 | |
| Prompt-basedAttack Type=Prompt-based (Any), Embedder=Any, VLM=Any2025.04 | 1 | 8 | -0.04 | 0.17 | 1 | — |