Membership Inference Attack on VL-MIA Flickr (test)
0.736AUCCSA-MIA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CSA-MIAType=Black-Box, Target Model=GPT-42026.05 | 0.736 | 0.22 | 0.27 | 0.844 | 0.608 | |
| Image-only InferenceType=Black-Box, Target Model=GPT-42026.05 | 0.658 | 0.04 | 0.09 | 0.643 | 0.52 | |
| Max-Prob-GapType=Gray-Box, Target Model=GPT-42026.05 | 0.616 | 0.219 | 0.182 | 0.783 | 0.566 | |
| Aug-KLType=Gray-Box, Target Model=GPT-42026.05 | 0.483 | -0.03 | 0.02 | 0.333 | 0.49 | |
| Min-0%++Type=Gray-Box, Target Model=GPT-42026.05 | 0.44 | -0.01 | 0.04 | 0.444 | 0.495 | |
| Min-10%++Type=Gray-Box, Target Model=GPT-42026.05 | 0.423 | -0.01 | 0.04 | 0.444 | 0.495 | |
| Min-0% ProbType=Gray-Box, Target Model=GPT-42026.05 | 0.413 | -0.01 | 0.04 | 0.444 | 0.495 | |
| Min-10% ProbType=Gray-Box, Target Model=GPT-42026.05 | 0.408 | -0.03 | 0.02 | 0.25 | 0.48 | |
| ModRényiType=Gray-Box, Target Model=GPT-42026.05 | 0.407 | -0.01 | 0.04 | 0.571 | 0.505 | |
| Min-20%++Type=Gray-Box, Target Model=GPT-42026.05 | 0.403 | -0.03 | 0.02 | 0.286 | 0.485 | |
| Min-20% ProbType=Gray-Box, Target Model=GPT-42026.05 | 0.382 | 0.011 | 0.061 | 0.6 | 0.51 | |
| MaxRényi-Max-0%Type=Gray-Box, Target Model=GPT-42026.05 | 0.375 | -0.02 | 0.03 | 0.375 | 0.49 | |
| MaxRényi-Max-10%Type=Gray-Box, Target Model=GPT-42026.05 | 0.362 | -0.01 | 0.04 | 0.364 | 0.485 | |
| PerplexityType=Gray-Box, Target Model=GPT-42026.05 | 0.358 | -0.03 | 0.02 | 0.286 | 0.485 | |
| MaxRényi-Max-100%Type=Gray-Box, Target Model=GPT-42026.05 | 0.306 | -0.04 | 0.01 | 0.167 | 0.48 |