Membership Inference Attack on MSCOCO RagVL (randomly sampled 200 prompts)
0.82AUCImageAuditor
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ImageAuditorRetrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.82 | 76 | 39 | |
| PoisonedRAG-B*Retrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.57 | 59 | 14 | |
| PoisonedRAG*Retrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.51 | 56 | 6 | |
| BadRAG*Retrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.49 | 54 | 3 |