List your company
ResearchFormerly WizWand

Image Membership Inference Attack on VL-MIA DALL-E (test)

81.5AUCMaxRényi-K%
50.40458.47766.5574.623Nov 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=0.5, Max_K%=100%2024.1181.5
Perplexity/zlib*Target Model=GPT-4-vision-preview2024.1180.7
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=1, Max_K%=100%2024.1179
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=2, Max_K%=100%2024.1178.6
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=∞, Max_K%=100%2024.1178.1
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=0.5, Max_K%=10%2024.1174.9
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=1, Max_K%=10%2024.1174.7
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=2, Max_K%=10%2024.1172.3
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=∞, Max_K%=10%2024.1170.8
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=0.5, Max_K%=0%2024.1169.7
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=1, Max_K%=0%2024.1168.8
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=∞, Max_K%=0%2024.1168.5
MaxRényi-K%Target Model=GPT-4-vision-preview, Alpha (α)=2, Max_K%=0%2024.1167.8
Max_Prob_GapTarget Model=GPT-4-vision-preview2024.1151.6