List your company
ResearchFormerly WizWand

Text Membership Inference Attack on LLaVA LLM Pre-training

0.688AUCMaxRényi-K%
0.414480.485490.55650.62751Nov 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
MaxRényi-K%alpha=inf, K=0%, training_samples=1282024.110.688
MaxRényi-K%alpha=inf, K=0%, training_samples=2562024.110.669
MaxRényi-K%alpha=1, K=0%, training_samples=2562024.110.668
MaxRényi-K%alpha=inf, K=10%, training_samples=2562024.110.667
MaxRényi-K%alpha=2, K=10%, training_samples=2562024.110.663
MaxRényi-K%alpha=2, K=0%, training_samples=1282024.110.659
MaxRényi-K%alpha=2, K=0%, training_samples=2562024.110.657
MaxRényi-K%alpha=0.5, K=10%, training_samples=2562024.110.65
MaxRényi-K%alpha=1, K=10%, training_samples=2562024.110.65
MaxRényi-K%alpha=2, K=100%, training_samples=2562024.110.649
MaxRényi-K%alpha=inf, K=100%, training_samples=2562024.110.634
MaxRényi-K%alpha=0.5, K=100%, training_samples=2562024.110.631
Max_Prob_Gaptraining_samples=2562024.110.629
MaxRényi-K%alpha=2, K=10%, training_samples=1282024.110.629
MaxRényi-K%alpha=inf, K=10%, training_samples=1282024.110.627
MaxRényi-K%alpha=1, K=10%, training_samples=1282024.110.623
MaxRényi-K%alpha=1, K=100%, training_samples=2562024.110.621
MaxRényi-K%alpha=inf, K=0%, training_samples=642024.110.615
MaxRényi-K%alpha=inf, K=0%, training_samples=322024.110.607
MaxRényi-K%alpha=0.5, K=10%, training_samples=1282024.110.606
MaxRényi-K%alpha=2, K=0%, training_samples=642024.110.606
Perplexity/zlibtraining_samples=2562024.110.603
MaxRényi-K%alpha=1, K=0%, training_samples=1282024.110.603
MaxRényi-K%alpha=0.5, K=100%, training_samples=1282024.110.6
MaxRényi-K%alpha=2, K=0%, training_samples=322024.110.594
MaxRényi-K%alpha=2, K=100%, training_samples=322024.110.592
MaxRényi-K%alpha=1, K=100%, training_samples=1282024.110.588
MaxRényi-K%alpha=inf, K=10%, training_samples=322024.110.586
MaxRényi-K%alpha=inf, K=100%, training_samples=1282024.110.584
Perplexity/lowercasetraining_samples=2562024.110.583
MaxRényi-K%alpha=2, K=10%, training_samples=322024.110.583
Perplexitytraining_samples=2562024.110.582
Perplexity/zlibtraining_samples=1282024.110.581
MaxRényi-K%alpha=2, K=100%, training_samples=642024.110.576
Max_Prob_Gaptraining_samples=322024.110.574
MaxRényi-K%alpha=0.5, K=0%, training_samples=2562024.110.571
MaxRényi-K%alpha=1, K=0%, training_samples=642024.110.571
MaxRényi-K%alpha=2, K=100%, training_samples=1282024.110.568
ModRényialpha=0.5, training_samples=2562024.110.567
ModRényialpha=1, training_samples=2562024.110.567
MaxRényi-K%alpha=1, K=0%, training_samples=322024.110.566
Max_Prob_Gaptraining_samples=1282024.110.565
Min-K%K=20%, training_samples=2562024.110.562
Perplexity/zlibtraining_samples=322024.110.56
ModRényialpha=2, training_samples=2562024.110.56
ModRényialpha=2, training_samples=322024.110.559
ModRényialpha=0.5, training_samples=322024.110.557
MaxRényi-K%alpha=2, K=10%, training_samples=642024.110.556
MaxRényi-K%alpha=0.5, K=100%, training_samples=322024.110.555
Perplexitytraining_samples=1282024.110.553
MaxRényi-K%alpha=1, K=10%, training_samples=322024.110.553
Min-K%K=20%, training_samples=1282024.110.549
MaxRényi-K%alpha=inf, K=10%, training_samples=642024.110.548
ModRényialpha=1, training_samples=1282024.110.546
MaxRényi-K%alpha=inf, K=100%, training_samples=322024.110.546
Max_Prob_Gaptraining_samples=642024.110.544
ModRényialpha=1, training_samples=322024.110.544
MaxRényi-K%alpha=1, K=100%, training_samples=322024.110.544
Perplexitytraining_samples=322024.110.542
MaxRényi-K%alpha=0.5, K=0%, training_samples=322024.110.541
MaxRényi-K%alpha=1, K=10%, training_samples=642024.110.541
Perplexity/zlibtraining_samples=642024.110.537
ModRényialpha=0.5, training_samples=1282024.110.536
Min-K%K=10%, training_samples=2562024.110.534
MaxRényi-K%alpha=0.5, K=100%, training_samples=642024.110.531
ModRényialpha=2, training_samples=1282024.110.529
MaxRényi-K%alpha=inf, K=100%, training_samples=642024.110.527
Min-K%K=10%, training_samples=1282024.110.526
MaxRényi-K%alpha=0.5, K=10%, training_samples=642024.110.525
MaxRényi-K%alpha=1, K=100%, training_samples=642024.110.523
Perplexity/lowercasetraining_samples=642024.110.518
MaxRényi-K%alpha=0.5, K=10%, training_samples=322024.110.518
MaxRényi-K%alpha=0.5, K=0%, training_samples=642024.110.515
Perplexitytraining_samples=642024.110.505
Min-K%K=20%, training_samples=322024.110.505
Perplexity/lowercasetraining_samples=1282024.110.503
ModRényialpha=1, training_samples=642024.110.503
ModRényialpha=0.5, training_samples=642024.110.5
Min-K%K=20%, training_samples=642024.110.498
ModRényialpha=2, training_samples=642024.110.497
Perplexity/lowercasetraining_samples=322024.110.493
MaxRényi-K%alpha=0.5, K=0%, training_samples=1282024.110.489
Min-K%K=10%, training_samples=642024.110.487
Min-K%K=10%, training_samples=322024.110.468
Min-K%K=0%, training_samples=322024.110.455
Min-K%K=0%, training_samples=642024.110.451
Min-K%K=0%, training_samples=2562024.110.448
Min-K%K=0%, training_samples=1282024.110.425