Membership Inference Attack on Flickr (test)
74.16AUCSecMI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SecMIFiltering Setting=filtered2025.11 | 74.16 | 68.51 | 6.46 | |
| RényiVictim Model=LLaVA, Alpha=1, Pooling Strategy=Max-10%, Input Slice=INST+DESP2026.04 | 73.9 | — | — | |
| SimAFiltering Setting=filtered2025.11 | 73.61 | 68.45 | 3.49 | |
| AutoMIAVictim Model=LLaVA, Agent Backbone=DeepSeek-V3.2-Reasoner, Input Slice=INST+DESP2026.04 | 73.4 | — | — | |
| AutoMIAVictim Model=LLaVA, Agent Backbone=DeepSeek-V3.2-Reasoner, Input Slice=INST2026.04 | 72.9 | — | — | |
| PIAFiltering Setting=filtered2025.11 | 71.85 | 67.11 | 3.46 | |
| SecMIFiltering Setting=None2025.11 | 71.81 | 66.54 | 5.29 | |
| AutoMIAVictim Model=LLaVA, Agent Backbone=DeepSeek-V3.2-Reasoner, Input Slice=DESP2026.04 | 71.5 | — | — | |
| SimAFiltering Setting=None2025.11 | 70.04 | 65.96 | 2.59 | |
| AutoMIAVictim Model=LLaVA, Agent Backbone=DeepSeek-V3.2-Reasoner, Input Slice=IMG2026.04 | 70 | — | — | |
| SimAFiltering Setting=random drop2025.11 | 69.85 | 65.66 | 2.79 | |
| PIAFiltering Setting=None2025.11 | 68.88 | 64.61 | 2.67 | |
| PerplexityVictim Model=LLaVA, Input Slice=DESP2026.04 | 66.2 | — | — | |
| Max Prob GapVictim Model=LLaVA, Input Slice=INST+DESP2026.04 | 64.6 | — | — | |
| LossFiltering Setting=filtered2025.11 | 64.57 | 60.49 | 2.81 | |
| Max Prob GapVictim Model=LLaVA, Input Slice=DESP2026.04 | 64.5 | — | — | |
| LossFiltering Setting=None2025.11 | 63.13 | 59.74 | 2.35 | |
| Max Prob GapVictim Model=LLaVA, Input Slice=INST2026.04 | 60.3 | — | — | |
| Max Prob GapVictim Model=LLaVA, Input Slice=IMG2026.04 | 57.9 | — | — | |
| PerplexityVictim Model=LLaVA, Input Slice=INST+DESP2026.04 | 55.4 | — | — | |
| PerplexityVictim Model=LLaVA, Input Slice=INST2026.04 | 37.8 | — | — |