List your company
ResearchFormerly WizWand

Membership Inference Attack on Flickr

27.7TPR @ 5% FPRAutoMIA
1.78.4515.221.95Mar 19, 2026Mar 21, 2026Mar 23, 2026Mar 25, 2026Mar 27, 2026Mar 29, 2026Apr 1, 2026
Updated 7mo ago

Evaluation results

MethodLinks
AutoMIALogit Type=Text Logits2026.0327.771.914.5
Max Prob GapTarget Model=LLAMA Adapter, Input Slice=desp2026.0423——
RényiTarget Model=LLaVA, Input Slice=inst, alpha=0.5, type=MAX-0%2026.0421.7——
RényiTarget Model=LLaVA, Input Slice=inst+desp, alpha=0.5, type=MAX-0%2026.0421.3——
AutoMIATarget Model=LLaVA, Input Slice=inst+desp, reasoner=DEEPSEEK-V3.2-REASONER2026.0421——
OpenEvolveLogit Type=Text Logits2026.0320.863.65.7
AutoMIALogit Type=Image Logits2026.0318.9774.4
Max Prob GapTarget Model=LLAMA Adapter, Input Slice=inst+desp2026.0418.3——
RényiTarget Model=LLAMA Adapter, Input Slice=inst, alpha=1, type=MAX-10%2026.0418——
AutoMIATarget Model=LLAMA Adapter, Input Slice=inst, reasoner=DEEPSEEK-V3.2-REASONER2026.0417.7——
Li et al., 2024Logit Type=Text Logits2026.0316.473.67.5
Max Prob GapTarget Model=LLaVA, Input Slice=desp2026.0416——
Max Prob GapTarget Model=LLaVA, Input Slice=inst+desp2026.0416——
RényiTarget Model=LLaVA, Input Slice=inst, alpha=1, type=MAX-10%2026.0415.3——
AutoMIATarget Model=LLaVA, Input Slice=inst, reasoner=DEEPSEEK-V3.2-REASONER2026.0414.3——
AutoMIATarget Model=LLaVA, Input Slice=desp, reasoner=DEEPSEEK-V3.2-REASONER2026.0414.3——
Li et al., 2024Logit Type=Image Logits2026.0313.2593.1
PerplexityTarget Model=LLaVA, Input Slice=desp2026.0413——
Min-k ProbTarget Model=LLaVA, Input Slice=desp, k_threshold=20%2026.0413——
AutoMIATarget Model=MiniGPT-4, Input Slice=inst+desp, reasoner=DEEPSEEK-V3.2-REASONER2026.0412.3——
AutoMIATarget Model=LLAMA Adapter, Input Slice=inst+desp, reasoner=DEEPSEEK-V3.2-REASONER2026.0412.3——
RényiTarget Model=LLaVA, Input Slice=inst+desp, alpha=1, type=MAX-10%2026.0412——
AutoMIATarget Model=LLAMA Adapter, Input Slice=desp, reasoner=DEEPSEEK-V3.2-REASONER2026.0412——
ModRényiTarget Model=LLaVA, Input Slice=desp, alpha=0.52026.0411.7——
RényiTarget Model=LLAMA Adapter, Input Slice=inst+desp, alpha=1, type=MAX-10%2026.0411.7——
AutoMIATarget Model=MiniGPT-4, Input Slice=img, reasoner=DEEPSEEK-V3.2-REASONER2026.0411.7——
Min-k ProbTarget Model=LLaVA, Input Slice=img, k_threshold=10%2026.0411.3——
ModRényiTarget Model=LLaVA, Input Slice=desp, alpha=12026.0411.3——
ModRényiTarget Model=LLaVA, Input Slice=desp, alpha=22026.0411.3——
ModRényiTarget Model=LLaVA, Input Slice=inst+desp, alpha=22026.0411.3——
RényiTarget Model=LLaVA, Input Slice=img, alpha=inf, type=MAX-10%2026.0411.3——
ModRényiTarget Model=LLaVA, Input Slice=inst+desp, alpha=0.52026.0411——
RényiTarget Model=LLaVA, Input Slice=inst+desp, alpha=inf, type=MAX-10%2026.0411——
RényiTarget Model=MiniGPT-4, Input Slice=inst, alpha=0.5, type=MAX-0%2026.0410.7——
RényiTarget Model=LLAMA Adapter, Input Slice=desp, alpha=0.5, type=MAX-0%2026.0410.7——
ModRényiTarget Model=LLAMA Adapter, Input Slice=desp, alpha=0.52026.0410——
AutoMIATarget Model=MiniGPT-4, Input Slice=inst, reasoner=DEEPSEEK-V3.2-REASONER2026.0410——
PerplexityTarget Model=LLAMA Adapter, Input Slice=desp2026.049.7——
Min-k ProbTarget Model=LLaVA, Input Slice=img, k_threshold=0%2026.049.7——
ModRényiTarget Model=LLAMA Adapter, Input Slice=desp, alpha=22026.049.7——
AutoMIATarget Model=MiniGPT-4, Input Slice=desp, reasoner=DEEPSEEK-V3.2-REASONER2026.049.7——
Min-k ProbTarget Model=LLaVA, Input Slice=img, k_threshold=20%2026.049.3——
RényiTarget Model=LLaVA, Input Slice=inst, alpha=inf, type=MAX-10%2026.049.3——
ModRényiTarget Model=LLAMA Adapter, Input Slice=desp, alpha=12026.049——
RényiTarget Model=LLaVA, Input Slice=img, alpha=1, type=MAX-10%2026.049——
RényiTarget Model=MiniGPT-4, Input Slice=inst, alpha=1, type=MAX-10%2026.048.7——
PerplexityTarget Model=LLaVA, Input Slice=inst+desp2026.048.3——
Min-k ProbTarget Model=LLaVA, Input Slice=desp, k_threshold=0%2026.048.3——
Min-k ProbTarget Model=LLaVA, Input Slice=desp, k_threshold=10%2026.048.3——
Min-k ProbTarget Model=LLAMA Adapter, Input Slice=desp, k_threshold=20%2026.048.3——
RényiTarget Model=LLaVA, Input Slice=desp, alpha=inf, type=MAX-10%2026.048.3——
OpenEvolveLogit Type=Image Logits2026.038.272.51.3
RényiTarget Model=LLaVA, Input Slice=desp, alpha=0.5, type=MAX-0%2026.048——
RényiTarget Model=MiniGPT-4, Input Slice=inst+desp, alpha=0.5, type=MAX-0%2026.048——
Max Prob GapTarget Model=LLaVA, Input Slice=inst2026.047.7——
ModRényiTarget Model=LLaVA, Input Slice=img, alpha=0.52026.047.7——
RényiTarget Model=LLAMA Adapter, Input Slice=desp, alpha=1, type=MAX-10%2026.047.7——
ModRényiTarget Model=LLaVA, Input Slice=img, alpha=12026.047.3——
ModRényiTarget Model=LLaVA, Input Slice=img, alpha=22026.047.3——
AutoMIATarget Model=LLaVA, Input Slice=img, reasoner=DEEPSEEK-V3.2-REASONER2026.047.3——
PerplexityTarget Model=LLaVA, Input Slice=img2026.047——
Aug-KLTarget Model=LLaVA, Input Slice=inst+desp2026.046.7——
Aug-KLTarget Model=LLAMA Adapter, Input Slice=desp2026.046.7——
Min-k ProbTarget Model=LLAMA Adapter, Input Slice=desp, k_threshold=0%2026.046.7——
RényiTarget Model=MiniGPT-4, Input Slice=img, alpha=0.5, type=MAX-0%2026.046.7——
RényiTarget Model=LLaVA, Input Slice=desp, alpha=1, type=MAX-10%2026.046.7——
Aug-KLTarget Model=LLAMA Adapter, Input Slice=inst+desp2026.046.3——
ModRényiTarget Model=LLaVA, Input Slice=inst+desp, alpha=12026.046.3——
RényiTarget Model=MiniGPT-4, Input Slice=img, alpha=1, type=MAX-10%2026.046.3——
Max Prob GapTarget Model=LLAMA Adapter, Input Slice=inst2026.046——
Min-k ProbTarget Model=LLAMA Adapter, Input Slice=desp, k_threshold=10%2026.046——
Max Prob GapTarget Model=LLaVA, Input Slice=img2026.045.7——
Aug-KLTarget Model=LLaVA, Input Slice=inst2026.045.7——
Aug-KLTarget Model=LLaVA, Input Slice=desp2026.045.7——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=inst, k_threshold=0%2026.045.4——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=inst, k_threshold=10%2026.045.4——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=inst+desp, k_threshold=0%2026.045.3——
Max Prob GapTarget Model=MiniGPT-4, Input Slice=inst2026.045——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=inst, k_threshold=20%2026.044.4——
Aug-KLTarget Model=LLAMA Adapter, Input Slice=inst2026.044.3——
RényiTarget Model=LLaVA, Input Slice=img, alpha=0.5, type=MAX-0%2026.044.3——
RényiTarget Model=LLAMA Adapter, Input Slice=inst+desp, alpha=0.5, type=MAX-0%2026.044.3——
Aug-KLTarget Model=LLaVA, Input Slice=img2026.044——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=img, k_threshold=0%2026.044——
ModRényiTarget Model=LLAMA Adapter, Input Slice=inst+desp, alpha=22026.044——
RényiTarget Model=LLAMA Adapter, Input Slice=inst, alpha=0.5, type=MAX-0%2026.044——
Aug-KLTarget Model=MiniGPT-4, Input Slice=img2026.043.3——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=img, k_threshold=20%2026.043.3——
RényiTarget Model=MiniGPT-4, Input Slice=inst+desp, alpha=1, type=MAX-10%2026.043.3——
Max Prob GapTarget Model=MiniGPT-4, Input Slice=img2026.043——
Min-k ProbTarget Model=LLAMA Adapter, Input Slice=inst, k_threshold=0%2026.043——
Min-k ProbTarget Model=LLAMA Adapter, Input Slice=inst+desp, k_threshold=0%2026.043——
ModRényiTarget Model=MiniGPT-4, Input Slice=img, alpha=22026.043——
Max Prob GapTarget Model=MiniGPT-4, Input Slice=desp2026.042.7——
Aug-KLTarget Model=MiniGPT-4, Input Slice=inst2026.042.7——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=desp, k_threshold=0%2026.042.7——
Min-k ProbTarget Model=MiniGPT-4, Input Slice=img, k_threshold=10%2026.042.7——
ModRényiTarget Model=MiniGPT-4, Input Slice=img, alpha=0.52026.042.7——
ModRényiTarget Model=MiniGPT-4, Input Slice=inst, alpha=0.52026.042.7——
ModRényiTarget Model=LLAMA Adapter, Input Slice=inst+desp, alpha=0.52026.042.7——