Accuracy on Membership Inference Attack on Flickr
68.7AccuracyAutoMIA
Evaluation Results
| Method | Links | |
|---|---|---|
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=desp2026.04 | 68.7 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=inst2026.04 | 68.3 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=inst+desp2026.04 | 67.8 | |
| Renyialpha=0.5, Top-k=100%, Model=LLaVA, Logit Slice=img2026.04 | 67.5 | |
| Renyialpha=1, Top-k=100%, Model=LLaVA, Logit Slice=img2026.04 | 67.3 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaVA, Logit Slice=img2026.04 | 67.3 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaMA Adapter, Logit Slice=inst2026.04 | 66.2 | |
| Renyialpha=2, Top-k=100%, Model=LLaVA, Logit Slice=img2026.04 | 65.2 | |
| Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=desp2026.04 | 64.8 | |
| Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=desp2026.04 | 64 | |
| ModRenyialpha=1, Model=LLaVA, Logit Slice=img2026.04 | 64 | |
| ModRenyialpha=0.5, Model=LLaVA, Logit Slice=img2026.04 | 63.8 | |
| ModRenyialpha=2, Model=LLaVA, Logit Slice=img2026.04 | 63.8 | |
| PerplexityModel=LLaVA, Logit Slice=img2026.04 | 63.7 | |
| Renyialpha=inf, Top-k=100%, Model=LLaVA, Logit Slice=img2026.04 | 63.7 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaMA Adapter, Logit Slice=inst+desp2026.04 | 63 | |
| PerplexityModel=LLaVA, Logit Slice=desp2026.04 | 62.3 | |
| Max Prob GapModel=LLaVA, Logit Slice=inst+desp2026.04 | 62.3 | |
| Max Prob GapModel=LLaMA Adapter, Logit Slice=desp2026.04 | 62.2 | |
| Max Prob GapModel=LLaVA, Logit Slice=desp2026.04 | 62 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=LLaMA Adapter, Logit Slice=desp2026.04 | 61.8 | |
| Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=desp2026.04 | 61.5 | |
| Renyialpha=1, Top-k=10%, Model=LLaVA, Logit Slice=img2026.04 | 61.3 | |
| Aug-KLModel=LLaVA, Logit Slice=img2026.04 | 61 | |
| Max Prob GapModel=LLaMA Adapter, Logit Slice=inst+desp2026.04 | 60.7 | |
| Renyialpha=2, Top-k=10%, Model=LLaVA, Logit Slice=img2026.04 | 60.3 | |
| PerplexityModel=LLaMA Adapter, Logit Slice=desp2026.04 | 59 | |
| Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=img2026.04 | 58.3 | |
| Renyialpha=2, Top-k=0%, Model=LLaVA, Logit Slice=img2026.04 | 58.3 | |
| Max Prob GapModel=LLaVA, Logit Slice=inst2026.04 | 58.2 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=inst2026.04 | 58.2 | |
| Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=img2026.04 | 58 | |
| Renyialpha=inf, Top-k=10%, Model=LLaVA, Logit Slice=img2026.04 | 58 | |
| Max Prob GapModel=LLaVA, Logit Slice=img2026.04 | 57.5 | |
| Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=img2026.04 | 57.3 | |
| Renyialpha=0.5, Top-k=10%, Model=LLaVA, Logit Slice=img2026.04 | 57.3 | |
| Renyialpha=inf, Top-k=0%, Model=LLaVA, Logit Slice=img2026.04 | 57.3 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=inst+desp2026.04 | 57.2 | |
| Max Prob GapModel=MiniGPT-4, Logit Slice=inst2026.04 | 57.1 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=desp2026.04 | 56.7 | |
| AutoMIAAgent Reasoner=DeepSeek-V3.2-Reasoner, Model=MiniGPT-4, Logit Slice=img2026.04 | 56.5 | |
| Aug-KLModel=LLaVA, Logit Slice=inst2026.04 | 56.2 | |
| PerplexityModel=LLaVA, Logit Slice=inst+desp2026.04 | 54.8 | |
| PerplexityModel=MiniGPT-4, Logit Slice=img2026.04 | 54.5 | |
| Renyialpha=0.5, Top-k=0%, Model=LLaVA, Logit Slice=img2026.04 | 53.7 | |
| Max Prob GapModel=MiniGPT-4, Logit Slice=img2026.04 | 53.3 | |
| Aug-KLModel=LLaVA, Logit Slice=inst+desp2026.04 | 52.5 | |
| Renyialpha=1, Top-k=0%, Model=LLaVA, Logit Slice=img2026.04 | 52.3 | |
| Aug-KLModel=LLaMA Adapter, Logit Slice=inst+desp2026.04 | 51.8 | |
| Aug-KLModel=LLaMA Adapter, Logit Slice=inst2026.04 | 51.5 | |
| Max Prob GapModel=LLaMA Adapter, Logit Slice=inst2026.04 | 51.3 | |
| Aug-KLModel=LLaMA Adapter, Logit Slice=desp2026.04 | 51.3 | |
| Aug-KLModel=LLaVA, Logit Slice=desp2026.04 | 51.2 | |
| Max Prob GapModel=MiniGPT-4, Logit Slice=inst+desp2026.04 | 51 | |
| Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=inst2026.04 | 50.8 | |
| Max Prob GapModel=MiniGPT-4, Logit Slice=desp2026.04 | 50.5 | |
| Aug-KLModel=MiniGPT-4, Logit Slice=img2026.04 | 50.5 | |
| PerplexityModel=MiniGPT-4, Logit Slice=inst2026.04 | 50.3 | |
| Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=inst+desp2026.04 | 50.3 | |
| PerplexityModel=LLaVA, Logit Slice=inst2026.04 | 50.2 | |
| PerplexityModel=LLaMA Adapter, Logit Slice=inst+desp2026.04 | 50.2 | |
| Aug-KLModel=MiniGPT-4, Logit Slice=desp2026.04 | 50.2 | |
| Aug-KLModel=MiniGPT-4, Logit Slice=inst+desp2026.04 | 50.2 | |
| Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=inst2026.04 | 50.2 | |
| Min-k Probk-percent=0%, Model=LLaVA, Logit Slice=inst+desp2026.04 | 50.2 | |
| Min-k Probk-percent=10%, Model=LLaVA, Logit Slice=inst2026.04 | 50.2 | |
| Min-k Probk-percent=20%, Model=LLaVA, Logit Slice=inst+desp2026.04 | 50.2 | |
| PerplexityModel=MiniGPT-4, Logit Slice=desp2026.04 | 50 | |
| PerplexityModel=MiniGPT-4, Logit Slice=inst+desp2026.04 | 50 | |
| PerplexityModel=LLaMA Adapter, Logit Slice=inst2026.04 | 50 | |
| Aug-KLModel=MiniGPT-4, Logit Slice=inst2026.04 | 50 |