Targeted poisoning attack on ViDoRe ESG v2 (test)
100ASR @1White-box
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| White-boxEmbedder=CLIP-L, VLM=InternVL3-2B2025.04 | 100 | 100 | 79 | 100 | 10 | |
| White-boxEmbedder=CLIP-L, VLM=Qwen2.5-3B2025.04 | 100 | 100 | 81 | 100 | 9 | |
| White-boxEmbedder=CLIP-L, VLM=SmolVLM2025.04 | 100 | 100 | 100 | 100 | 12 | |
| White-boxEmbedder=ColPali, VLM=InternVL3-2B2025.04 | 100 | 100 | 46 | 100 | 10 | |
| White-boxEmbedder=ColPali, VLM=Qwen2.5-3B2025.04 | 100 | 100 | 40 | 82 | 8 | |
| White-boxEmbedder=ColPali, VLM=SmolVLM2025.04 | 100 | 100 | 42 | 100 | 11 | |
| White-boxEmbedder=GME, VLM=InternVL3-2B2025.04 | 100 | 100 | 78 | 100 | 9 | |
| White-boxEmbedder=GME, VLM=Qwen2.5-3B2025.04 | 100 | 100 | 97 | 100 | 9 | |
| White-boxEmbedder=GME, VLM=SmolVLM2025.04 | 100 | 100 | 97 | 100 | 12 |