List your company
ResearchFormerly WizWand

Accuracy on Membership Inference Attack on Flickr

68.7AccuracyAutoMIA
49.25254.30159.3564.399Apr 1, 2026
Updated 7mo ago

Evaluation results

MethodLinks
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=desp2026.0468.7
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=inst2026.0468.3
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=inst+desp2026.0467.8
Renyialpha=0.5, Top-k=100%, Model=LLaVA, Logit Slice=img2026.0467.5
Renyialpha=1, Top-k=100%, Model=LLaVA, Logit Slice=img2026.0467.3
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=img2026.0467.3
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaMA Adapter, Logit Slice=inst2026.0466.2
Renyialpha=2, Top-k=100%, Model=LLaVA, Logit Slice=img2026.0465.2
Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=desp2026.0464.8
Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=desp2026.0464
ModRenyialpha=1, Model=LLaVA, Logit Slice=img2026.0464
ModRenyialpha=0.5, Model=LLaVA, Logit Slice=img2026.0463.8
ModRenyialpha=2, Model=LLaVA, Logit Slice=img2026.0463.8
PerplexityModel=LLaVA, Logit Slice=img2026.0463.7
Renyialpha=inf, Top-k=100%, Model=LLaVA, Logit Slice=img2026.0463.7
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaMA Adapter, Logit Slice=inst+desp2026.0463
PerplexityModel=LLaVA, Logit Slice=desp2026.0462.3
Max Prob GapModel=LLaVA, Logit Slice=inst+desp2026.0462.3
Max Prob GapModel=LLaMA Adapter, Logit Slice=desp2026.0462.2
Max Prob GapModel=LLaVA, Logit Slice=desp2026.0462
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaMA Adapter, Logit Slice=desp2026.0461.8
Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=desp2026.0461.5
Renyialpha=1, Top-k=10%, Model=LLaVA, Logit Slice=img2026.0461.3
Aug-KLModel=LLaVA, Logit Slice=img2026.0461
Max Prob GapModel=LLaMA Adapter, Logit Slice=inst+desp2026.0460.7
Renyialpha=2, Top-k=10%, Model=LLaVA, Logit Slice=img2026.0460.3
PerplexityModel=LLaMA Adapter, Logit Slice=desp2026.0459
Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=img2026.0458.3
Renyialpha=2, Top-k=0%, Model=LLaVA, Logit Slice=img2026.0458.3
Max Prob GapModel=LLaVA, Logit Slice=inst2026.0458.2
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=inst2026.0458.2
Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=img2026.0458
Renyialpha=inf, Top-k=10%, Model=LLaVA, Logit Slice=img2026.0458
Max Prob GapModel=LLaVA, Logit Slice=img2026.0457.5
Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=img2026.0457.3
Renyialpha=0.5, Top-k=10%, Model=LLaVA, Logit Slice=img2026.0457.3
Renyialpha=inf, Top-k=0%, Model=LLaVA, Logit Slice=img2026.0457.3
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=inst+desp2026.0457.2
Max Prob GapModel=MiniGPT-4, Logit Slice=inst2026.0457.1
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=desp2026.0456.7
AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=img2026.0456.5
Aug-KLModel=LLaVA, Logit Slice=inst2026.0456.2
PerplexityModel=LLaVA, Logit Slice=inst+desp2026.0454.8
PerplexityModel=MiniGPT-4, Logit Slice=img2026.0454.5
Renyialpha=0.5, Top-k=0%, Model=LLaVA, Logit Slice=img2026.0453.7
Max Prob GapModel=MiniGPT-4, Logit Slice=img2026.0453.3
Aug-KLModel=LLaVA, Logit Slice=inst+desp2026.0452.5
Renyialpha=1, Top-k=0%, Model=LLaVA, Logit Slice=img2026.0452.3
Aug-KLModel=LLaMA Adapter, Logit Slice=inst+desp2026.0451.8
Aug-KLModel=LLaMA Adapter, Logit Slice=inst2026.0451.5
Max Prob GapModel=LLaMA Adapter, Logit Slice=inst2026.0451.3
Aug-KLModel=LLaMA Adapter, Logit Slice=desp2026.0451.3
Aug-KLModel=LLaVA, Logit Slice=desp2026.0451.2
Max Prob GapModel=MiniGPT-4, Logit Slice=inst+desp2026.0451
Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=inst2026.0450.8
Max Prob GapModel=MiniGPT-4, Logit Slice=desp2026.0450.5
Aug-KLModel=MiniGPT-4, Logit Slice=img2026.0450.5
PerplexityModel=MiniGPT-4, Logit Slice=inst2026.0450.3
Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=inst+desp2026.0450.3
PerplexityModel=LLaVA, Logit Slice=inst2026.0450.2
PerplexityModel=LLaMA Adapter, Logit Slice=inst+desp2026.0450.2
Aug-KLModel=MiniGPT-4, Logit Slice=desp2026.0450.2
Aug-KLModel=MiniGPT-4, Logit Slice=inst+desp2026.0450.2
Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=inst2026.0450.2
Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=inst+desp2026.0450.2
Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=inst2026.0450.2
Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=inst+desp2026.0450.2
PerplexityModel=MiniGPT-4, Logit Slice=desp2026.0450
PerplexityModel=MiniGPT-4, Logit Slice=inst+desp2026.0450
PerplexityModel=LLaMA Adapter, Logit Slice=inst2026.0450
Aug-KLModel=MiniGPT-4, Logit Slice=inst2026.0450