Text Membership Inference Attack on LLaVA VLLM Tuning
0.993AUCModRényi
Evaluation Results
| Method | Links | |
|---|---|---|
| ModRényialpha=1, training_samples=642024.11 | 0.993 | |
| Perplexitytraining_samples=642024.11 | 0.988 | |
| Perplexity/zlibtraining_samples=642024.11 | 0.986 | |
| Min-K%K=20%, training_samples=642024.11 | 0.98 | |
| ModRényialpha=0.5, training_samples=642024.11 | 0.979 | |
| Perplexity/lowercasetraining_samples=642024.11 | 0.977 | |
| ModRényialpha=2, training_samples=642024.11 | 0.963 | |
| Perplexity/lowercasetraining_samples=322024.11 | 0.962 | |
| Min-K%K=10%, training_samples=642024.11 | 0.883 | |
| MaxRényi-K%alpha=0.5, K=100%, training_samples=642024.11 | 0.835 | |
| ModRényialpha=0.5, training_samples=322024.11 | 0.809 | |
| MaxRényi-K%alpha=1, K=10%, training_samples=642024.11 | 0.809 | |
| ModRényialpha=1, training_samples=322024.11 | 0.808 | |
| MaxRényi-K%alpha=2, K=10%, training_samples=642024.11 | 0.787 | |
| Perplexitytraining_samples=322024.11 | 0.779 | |
| ModRényialpha=2, training_samples=322024.11 | 0.779 | |
| MaxRényi-K%alpha=0.5, K=10%, training_samples=642024.11 | 0.776 | |
| MaxRényi-K%alpha=inf, K=10%, training_samples=642024.11 | 0.763 | |
| MaxRényi-K%alpha=1, K=100%, training_samples=642024.11 | 0.75 | |
| MaxRényi-K%alpha=2, K=100%, training_samples=642024.11 | 0.709 | |
| MaxRényi-K%alpha=inf, K=100%, training_samples=642024.11 | 0.694 | |
| MaxRényi-K%alpha=inf, K=0%, training_samples=642024.11 | 0.638 | |
| MaxRényi-K%alpha=2, K=0%, training_samples=642024.11 | 0.625 | |
| MaxRényi-K%alpha=inf, K=10%, training_samples=322024.11 | 0.618 | |
| Perplexity/zlibtraining_samples=322024.11 | 0.609 | |
| MaxRényi-K%alpha=2, K=10%, training_samples=322024.11 | 0.607 | |
| Min-K%K=20%, training_samples=322024.11 | 0.603 | |
| MaxRényi-K%alpha=inf, K=0%, training_samples=322024.11 | 0.6 | |
| MaxRényi-K%alpha=2, K=0%, training_samples=322024.11 | 0.589 | |
| MaxRényi-K%alpha=1, K=0%, training_samples=642024.11 | 0.579 | |
| MaxRényi-K%alpha=1, K=10%, training_samples=322024.11 | 0.566 | |
| MaxRényi-K%alpha=0.5, K=100%, training_samples=322024.11 | 0.564 | |
| MaxRényi-K%alpha=inf, K=100%, training_samples=322024.11 | 0.557 | |
| MaxRényi-K%alpha=1, K=100%, training_samples=322024.11 | 0.554 | |
| MaxRényi-K%alpha=2, K=100%, training_samples=322024.11 | 0.553 | |
| MaxRényi-K%alpha=1, K=0%, training_samples=322024.11 | 0.552 | |
| Max_Prob_Gaptraining_samples=642024.11 | 0.545 | |
| Min-K%K=0%, training_samples=322024.11 | 0.522 | |
| Min-K%K=0%, training_samples=642024.11 | 0.522 | |
| MaxRényi-K%alpha=0.5, K=0%, training_samples=642024.11 | 0.514 | |
| MaxRényi-K%alpha=0.5, K=0%, training_samples=322024.11 | 0.506 | |
| Min-K%K=10%, training_samples=322024.11 | 0.461 | |
| Max_Prob_Gaptraining_samples=322024.11 | 0.461 | |
| MaxRényi-K%alpha=0.5, K=10%, training_samples=322024.11 | 0.458 |