List your company
ResearchFormerly WizWand

Text Membership Inference Attack on LLaVA VLLM Tuning

0.993AUCModRényi
0.43660.581050.72550.86995Nov 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ModRényialpha=1, training_samples=642024.110.993
Perplexitytraining_samples=642024.110.988
Perplexity/zlibtraining_samples=642024.110.986
Min-K%K=20%, training_samples=642024.110.98
ModRényialpha=0.5, training_samples=642024.110.979
Perplexity/lowercasetraining_samples=642024.110.977
ModRényialpha=2, training_samples=642024.110.963
Perplexity/lowercasetraining_samples=322024.110.962
Min-K%K=10%, training_samples=642024.110.883
MaxRényi-K%alpha=0.5, K=100%, training_samples=642024.110.835
ModRényialpha=0.5, training_samples=322024.110.809
MaxRényi-K%alpha=1, K=10%, training_samples=642024.110.809
ModRényialpha=1, training_samples=322024.110.808
MaxRényi-K%alpha=2, K=10%, training_samples=642024.110.787
Perplexitytraining_samples=322024.110.779
ModRényialpha=2, training_samples=322024.110.779
MaxRényi-K%alpha=0.5, K=10%, training_samples=642024.110.776
MaxRényi-K%alpha=inf, K=10%, training_samples=642024.110.763
MaxRényi-K%alpha=1, K=100%, training_samples=642024.110.75
MaxRényi-K%alpha=2, K=100%, training_samples=642024.110.709
MaxRényi-K%alpha=inf, K=100%, training_samples=642024.110.694
MaxRényi-K%alpha=inf, K=0%, training_samples=642024.110.638
MaxRényi-K%alpha=2, K=0%, training_samples=642024.110.625
MaxRényi-K%alpha=inf, K=10%, training_samples=322024.110.618
Perplexity/zlibtraining_samples=322024.110.609
MaxRényi-K%alpha=2, K=10%, training_samples=322024.110.607
Min-K%K=20%, training_samples=322024.110.603
MaxRényi-K%alpha=inf, K=0%, training_samples=322024.110.6
MaxRényi-K%alpha=2, K=0%, training_samples=322024.110.589
MaxRényi-K%alpha=1, K=0%, training_samples=642024.110.579
MaxRényi-K%alpha=1, K=10%, training_samples=322024.110.566
MaxRényi-K%alpha=0.5, K=100%, training_samples=322024.110.564
MaxRényi-K%alpha=inf, K=100%, training_samples=322024.110.557
MaxRényi-K%alpha=1, K=100%, training_samples=322024.110.554
MaxRényi-K%alpha=2, K=100%, training_samples=322024.110.553
MaxRényi-K%alpha=1, K=0%, training_samples=322024.110.552
Max_Prob_Gaptraining_samples=642024.110.545
Min-K%K=0%, training_samples=322024.110.522
Min-K%K=0%, training_samples=642024.110.522
MaxRényi-K%alpha=0.5, K=0%, training_samples=642024.110.514
MaxRényi-K%alpha=0.5, K=0%, training_samples=322024.110.506
Min-K%K=10%, training_samples=322024.110.461
Max_Prob_Gaptraining_samples=322024.110.461
MaxRényi-K%alpha=0.5, K=10%, training_samples=322024.110.458