Text Membership Inference Attack on LLaVA LLM Pre-training
0.688AUCMaxRényi-K%
Evaluation Results
| Method | Links | |
|---|---|---|
| MaxRényi-K%alpha=inf, K=0%, training_samples=1282024.11 | 0.688 | |
| MaxRényi-K%alpha=inf, K=0%, training_samples=2562024.11 | 0.669 | |
| MaxRényi-K%alpha=1, K=0%, training_samples=2562024.11 | 0.668 | |
| MaxRényi-K%alpha=inf, K=10%, training_samples=2562024.11 | 0.667 | |
| MaxRényi-K%alpha=2, K=10%, training_samples=2562024.11 | 0.663 | |
| MaxRényi-K%alpha=2, K=0%, training_samples=1282024.11 | 0.659 | |
| MaxRényi-K%alpha=2, K=0%, training_samples=2562024.11 | 0.657 | |
| MaxRényi-K%alpha=0.5, K=10%, training_samples=2562024.11 | 0.65 | |
| MaxRényi-K%alpha=1, K=10%, training_samples=2562024.11 | 0.65 | |
| MaxRényi-K%alpha=2, K=100%, training_samples=2562024.11 | 0.649 | |
| MaxRényi-K%alpha=inf, K=100%, training_samples=2562024.11 | 0.634 | |
| MaxRényi-K%alpha=0.5, K=100%, training_samples=2562024.11 | 0.631 | |
| Max_Prob_Gaptraining_samples=2562024.11 | 0.629 | |
| MaxRényi-K%alpha=2, K=10%, training_samples=1282024.11 | 0.629 | |
| MaxRényi-K%alpha=inf, K=10%, training_samples=1282024.11 | 0.627 | |
| MaxRényi-K%alpha=1, K=10%, training_samples=1282024.11 | 0.623 | |
| MaxRényi-K%alpha=1, K=100%, training_samples=2562024.11 | 0.621 | |
| MaxRényi-K%alpha=inf, K=0%, training_samples=642024.11 | 0.615 | |
| MaxRényi-K%alpha=inf, K=0%, training_samples=322024.11 | 0.607 | |
| MaxRényi-K%alpha=0.5, K=10%, training_samples=1282024.11 | 0.606 | |
| MaxRényi-K%alpha=2, K=0%, training_samples=642024.11 | 0.606 | |
| Perplexity/zlibtraining_samples=2562024.11 | 0.603 | |
| MaxRényi-K%alpha=1, K=0%, training_samples=1282024.11 | 0.603 | |
| MaxRényi-K%alpha=0.5, K=100%, training_samples=1282024.11 | 0.6 | |
| MaxRényi-K%alpha=2, K=0%, training_samples=322024.11 | 0.594 | |
| MaxRényi-K%alpha=2, K=100%, training_samples=322024.11 | 0.592 | |
| MaxRényi-K%alpha=1, K=100%, training_samples=1282024.11 | 0.588 | |
| MaxRényi-K%alpha=inf, K=10%, training_samples=322024.11 | 0.586 | |
| MaxRényi-K%alpha=inf, K=100%, training_samples=1282024.11 | 0.584 | |
| Perplexity/lowercasetraining_samples=2562024.11 | 0.583 | |
| MaxRényi-K%alpha=2, K=10%, training_samples=322024.11 | 0.583 | |
| Perplexitytraining_samples=2562024.11 | 0.582 | |
| Perplexity/zlibtraining_samples=1282024.11 | 0.581 | |
| MaxRényi-K%alpha=2, K=100%, training_samples=642024.11 | 0.576 | |
| Max_Prob_Gaptraining_samples=322024.11 | 0.574 | |
| MaxRényi-K%alpha=0.5, K=0%, training_samples=2562024.11 | 0.571 | |
| MaxRényi-K%alpha=1, K=0%, training_samples=642024.11 | 0.571 | |
| MaxRényi-K%alpha=2, K=100%, training_samples=1282024.11 | 0.568 | |
| ModRényialpha=0.5, training_samples=2562024.11 | 0.567 | |
| ModRényialpha=1, training_samples=2562024.11 | 0.567 | |
| MaxRényi-K%alpha=1, K=0%, training_samples=322024.11 | 0.566 | |
| Max_Prob_Gaptraining_samples=1282024.11 | 0.565 | |
| Min-K%K=20%, training_samples=2562024.11 | 0.562 | |
| Perplexity/zlibtraining_samples=322024.11 | 0.56 | |
| ModRényialpha=2, training_samples=2562024.11 | 0.56 | |
| ModRényialpha=2, training_samples=322024.11 | 0.559 | |
| ModRényialpha=0.5, training_samples=322024.11 | 0.557 | |
| MaxRényi-K%alpha=2, K=10%, training_samples=642024.11 | 0.556 | |
| MaxRényi-K%alpha=0.5, K=100%, training_samples=322024.11 | 0.555 | |
| Perplexitytraining_samples=1282024.11 | 0.553 | |
| MaxRényi-K%alpha=1, K=10%, training_samples=322024.11 | 0.553 | |
| Min-K%K=20%, training_samples=1282024.11 | 0.549 | |
| MaxRényi-K%alpha=inf, K=10%, training_samples=642024.11 | 0.548 | |
| ModRényialpha=1, training_samples=1282024.11 | 0.546 | |
| MaxRényi-K%alpha=inf, K=100%, training_samples=322024.11 | 0.546 | |
| Max_Prob_Gaptraining_samples=642024.11 | 0.544 | |
| ModRényialpha=1, training_samples=322024.11 | 0.544 | |
| MaxRényi-K%alpha=1, K=100%, training_samples=322024.11 | 0.544 | |
| Perplexitytraining_samples=322024.11 | 0.542 | |
| MaxRényi-K%alpha=0.5, K=0%, training_samples=322024.11 | 0.541 | |
| MaxRényi-K%alpha=1, K=10%, training_samples=642024.11 | 0.541 | |
| Perplexity/zlibtraining_samples=642024.11 | 0.537 | |
| ModRényialpha=0.5, training_samples=1282024.11 | 0.536 | |
| Min-K%K=10%, training_samples=2562024.11 | 0.534 | |
| MaxRényi-K%alpha=0.5, K=100%, training_samples=642024.11 | 0.531 | |
| ModRényialpha=2, training_samples=1282024.11 | 0.529 | |
| MaxRényi-K%alpha=inf, K=100%, training_samples=642024.11 | 0.527 | |
| Min-K%K=10%, training_samples=1282024.11 | 0.526 | |
| MaxRényi-K%alpha=0.5, K=10%, training_samples=642024.11 | 0.525 | |
| MaxRényi-K%alpha=1, K=100%, training_samples=642024.11 | 0.523 | |
| Perplexity/lowercasetraining_samples=642024.11 | 0.518 | |
| MaxRényi-K%alpha=0.5, K=10%, training_samples=322024.11 | 0.518 | |
| MaxRényi-K%alpha=0.5, K=0%, training_samples=642024.11 | 0.515 | |
| Perplexitytraining_samples=642024.11 | 0.505 | |
| Min-K%K=20%, training_samples=322024.11 | 0.505 | |
| Perplexity/lowercasetraining_samples=1282024.11 | 0.503 | |
| ModRényialpha=1, training_samples=642024.11 | 0.503 | |
| ModRényialpha=0.5, training_samples=642024.11 | 0.5 | |
| Min-K%K=20%, training_samples=642024.11 | 0.498 | |
| ModRényialpha=2, training_samples=642024.11 | 0.497 | |
| Perplexity/lowercasetraining_samples=322024.11 | 0.493 | |
| MaxRényi-K%alpha=0.5, K=0%, training_samples=1282024.11 | 0.489 | |
| Min-K%K=10%, training_samples=642024.11 | 0.487 | |
| Min-K%K=10%, training_samples=322024.11 | 0.468 | |
| Min-K%K=0%, training_samples=322024.11 | 0.455 | |
| Min-K%K=0%, training_samples=642024.11 | 0.451 | |
| Min-K%K=0%, training_samples=2562024.11 | 0.448 | |
| Min-K%K=0%, training_samples=1282024.11 | 0.425 |