Membership Inference Attack on VL-MIA Flickr
0.793AUCMaxRényi_Max_100%
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MaxRényi_Max_100%Type=Gray-Box, Base Model=MiniGPT-42026.05 | 0.793 | 0.133 | 0.143 | 0.935 | 0.567 | 0.157 | 0.207 | 0.805 | 0.578 | 0.297 | 0.397 | 0.799 | 0.648 | |
| CSA-MIAType=Black-Box, Base Model=MiniGPT-42026.05 | 0.773 | 0.02 | 0.03 | 0.75 | 0.51 | 0.297 | 0.347 | 0.865 | 0.635 | 0.343 | 0.443 | 0.816 | 0.672 | |
| Min-20% ++Type=Gray-Box, Base Model=MiniGPT-42026.05 | 0.769 | 0.023 | 0.027 | 0.889 | 0.512 | 0.15 | 0.2 | 0.8 | 0.575 | 0.253 | 0.353 | 0.779 | 0.627 | |
| MaxRényi_Max_10%Type=Gray-Box, Base Model=MiniGPT-42026.05 | 0.749 | 0.053 | 0.063 | 0.864 | 0.527 | 0.157 | 0.207 | 0.805 | 0.578 | 0.227 | 0.323 | 0.77 | 0.613 | |
| Min-0% ++Type=Gray-Box, Base Model=MiniGPT-42026.05 | 0.71 | 0.01 | 0.02 | 0.667 | 0.505 | 0.107 | 0.157 | 0.758 | 0.553 | 0.207 | 0.307 | 0.754 | 0.603 | |
| Min-10% ++Type=Gray-Box, Base Model=MiniGPT-42026.05 | 0.71 | 0.01 | 0.02 | 0.667 | 0.505 | 0.107 | 0.157 | 0.758 | 0.553 | 0.207 | 0.307 | 0.754 | 0.603 | |
| Max_Prob_GapType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.678 | 0.023 | 0.033 | 0.769 | 0.512 | 0.103 | 0.153 | 0.754 | 0.552 | 0.153 | 0.25 | 0.721 | 0.577 | |
| MaxRényi_Max_0%Type=Gray-Box, Base Model=MiniGPT-42026.05 | 0.63 | 0.007 | 0.013 | 0.8 | 0.505 | 0.017 | 0.067 | 0.571 | 0.508 | 0.037 | 0.13 | 0.582 | 0.518 | |
| PerplexityType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.621 | 0.027 | 0.037 | 0.786 | 0.513 | 0.06 | 0.103 | 0.705 | 0.53 | 0.093 | 0.18 | 0.675 | 0.547 | |
| Image-only InferenceType=Black-Box, Base Model=MiniGPT-42026.05 | 0.617 | -0.007 | 0.003 | 0.25 | 0.497 | 0.027 | 0.077 | 0.622 | 0.515 | 0.087 | 0.187 | 0.651 | 0.543 | |
| Min_20% ProbType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.614 | 0 | 0.01 | 0.5 | 0.5 | 0.03 | 0.07 | 0.636 | 0.515 | 0.08 | 0.18 | 0.643 | 0.54 | |
| ModRényiType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.606 | 0.02 | 0.03 | 0.75 | 0.51 | 0.03 | 0.08 | 0.615 | 0.515 | 0.073 | 0.17 | 0.638 | 0.537 | |
| Min_10% ProbType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.587 | 0.007 | 0.013 | 0.667 | 0.503 | 0.013 | 0.063 | 0.559 | 0.507 | 0.053 | 0.153 | 0.605 | 0.527 | |
| Aug_KLType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.528 | 0.013 | 0.023 | 0.7 | 0.507 | 0.03 | 0.08 | 0.632 | 0.517 | 0.007 | 0.107 | 0.525 | 0.505 | |
| Min_0% ProbType=Gray-Box, Base Model=MiniGPT-42026.05 | 0.525 | 0.007 | 0.013 | 0.667 | 0.503 | 0 | 0.05 | 0.5 | 0.5 | 0.013 | 0.11 | 0.532 | 0.507 |