Membership Inference Attack on MMQA 1,000 images (non-member set)
0.85AUCImageAuditor
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ImageAuditorRetrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.85 | 82 | 56 | |
| PoisonedRAG-B*Retrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.62 | 62 | 19 | |
| PoisonedRAG*Retrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.53 | 57 | 6 | |
| BadRAG*Retrieval Model=CLIP ViT-L/14-336, Generation Model=Qwen2.5-VL-7B-Instruct, Extraction segment=Describe each retrieved image...2026.06 | 0.52 | 55 | 4 |