Retrieval on ViDoRe AI (Targeted Setting III) V1
100ASR-R@1 (Mean)MO-PGD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=InternVL3-2B2025.04 | 100 | 100 | |
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=Qwen2.5-3B2025.04 | 100 | 100 | |
| MO-PGDAttack Type=White-box, Embedder=CLIP-L, VLM=SmolVLM2025.04 | 100 | 100 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=InternVL3-2B2025.04 | 60 | 80 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=Qwen2.5-3B2025.04 | 60 | 80 | |
| MO-PGDAttack Type=White-box, Embedder=ColPali, VLM=SmolVLM2025.04 | 50 | 70 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=InternVL3-2B2025.04 | 50 | 70 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=SmolVLM2025.04 | 50 | 60 | |
| Prompt-based (Any)Attack Type=Prompt-based (Any), Embedder=Any, VLM=Any2025.04 | 48 | 68 | |
| MO-PGDAttack Type=White-box, Embedder=GME, VLM=Qwen2.5-3B2025.04 | 40 | 60 |