Image Membership Inference Attack on VL-MIA DALL-E (test)
81.5AUCMaxRényi-K%
Evaluation Results
| Method | Links | |
|---|---|---|
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=0.5, Max_K%=100%2024.11 | 81.5 | |
| Perplexity/zlib*Target Model=GPT-4-vision-preview2024.11 | 80.7 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=1, Max_K%=100%2024.11 | 79 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=2, Max_K%=100%2024.11 | 78.6 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=∞, Max_K%=100%2024.11 | 78.1 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=0.5, Max_K%=10%2024.11 | 74.9 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=1, Max_K%=10%2024.11 | 74.7 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=2, Max_K%=10%2024.11 | 72.3 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=∞, Max_K%=10%2024.11 | 70.8 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=0.5, Max_K%=0%2024.11 | 69.7 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=1, Max_K%=0%2024.11 | 68.8 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=∞, Max_K%=0%2024.11 | 68.5 | |
| MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=2, Max_K%=0%2024.11 | 67.8 | |
| Max_Prob_GapTarget Model=GPT-4-vision-preview2024.11 | 51.6 |