Membership Inference Attack on VL-MIA DALL-E 1.0 (test) benchmark leaderboard · SOTA2 Research

Membership Inference Attack on VL-MIA DALL-E 1.0 (test)

8.1TPR@5%FPR (Aug_KL)LLaVA

Updated 5mo ago

Evaluation Results

Method	Links
LLaVA2024.11		8.1	0.027	0.081	0.081	0.064	10.8	0.02	0.034	0.024	8.8	8.8	9.8	10.1	10.1	10.1	9.1	9.1	10.1	11.2	11.2	12.2
MiniGPT-42024.11		6.4	0.014	0.054	0.054	0.064	3.7	0.024	0.02	0.037	6.1	6.1	6.4	3.7	3.7	7.8	3	3	5.4	2.7	2.7	3.7
LLaVA2024.11		5.1	0.057	0.081	0.041	0.03	6.4	0.041	0.057	0.054	8.5	9.5	8.1	4.4	6.4	8.1	5.4	6.8	9.8	6.8	9.1	9.8
LLaVA2024.11		3.7	0.081	0.051	0.068	0.071	8.5	0.088	0.095	0.088	4.7	6.4	9.5	6.4	6.1	8.1	5.1	5.1	10.1	5.1	6.8	8.1
MiniGPT-42024.11		3.7	0.034	0.051	0.057	0.054	3	0.027	0.061	0.03	6.1	6.1	2	4.4	3.7	1.7	2.7	1.7	1.4	1.4	1.7	1.4
LLaMA Adapter2024.11		3.4	0.081	0.051	0.03	0.034	7.4	0.081	0.074	0.068	5.1	6.1	4.7	5.4	4.1	5.1	5.4	3.7	5.1	5.1	5.4	6.4
MiniGPT-42024.11		3	0.034	0.03	0.02	0.02	3.7	0.03	0.027	0.03	2	1.7	1.7	2.7	1.4	2.7	3	2	2.7	4.4	2	3.4
LLaMA Adapter2024.11		3	0.03	0.037	0.02	0.02	4.7	0.037	0.041	0.034	11.2	16.2	3	8.8	7.1	2.7	5.1	3.4	3	4.7	3.4	2.4
LLaMA Adapter2024.11		2.7	0.051	0.037	0.02	0.017	7.1	0.064	0.041	0.061	11.2	4.4	3.4	8.1	5.1	3.4	4.7	5.7	6.1	4.7	3.4	4.1
LLaVA2024.11		2	—	—	—	—	3.7	—	—	—	8.1	15.2	0.3	9.1	22	0.3	11.8	17.2	1.7	12.8	14.2	2.4
MiniGPT-42024.11		1.4	—	—	—	—	5.1	—	—	—	6.1	6.8	8.8	5.4	7.4	6.1	5.1	7.1	8.8	6.8	7.4	9.5