Membership Inference Attack on WikiMIA K = 16
0.643Attack PowerJECS
Evaluation Results
| Method | Links | |
|---|---|---|
| JECSModel=NeoX-20B, Score function=Min-K%++, alpha=0.3, K=162026.05 | 0.643 | |
| JECSModel=LLaMA-7B, Score function=Min-K%++, alpha=0.3, K=162026.05 | 0.592 | |
| JMCSModel=NeoX-20B, Score function=Min-K%++, alpha=0.3, K=162026.05 | 0.58 | |
| JECSModel=NeoX-20B, Score function=Min-K%++, alpha=0.2, K=162026.05 | 0.574 | |
| JECSModel=NeoX-20B, Score function=Perplexity, alpha=0.3, K=162026.05 | 0.565 | |
| JECSModel=NeoX-20B, Score function=Min-K%, alpha=0.3, K=162026.05 | 0.529 | |
| JECSModel=LLaMA-7B, Score function=Min-K%++, alpha=0.2, K=162026.05 | 0.527 | |
| JMCSModel=LLaMA-7B, Score function=Min-K%++, alpha=0.3, K=162026.05 | 0.526 | |
| JMCSModel=NeoX-20B, Score function=Min-K%++, alpha=0.2, K=162026.05 | 0.499 | |
| JECSModel=Pythia-6.9B, Score function=Min-K%++, alpha=0.3, K=162026.05 | 0.486 | |
| JECSModel=LLaMA-7B, Score function=Min-K%, alpha=0.3, K=162026.05 | 0.469 | |
| JECSModel=NeoX-20B, Score function=M-Entropy, alpha=0.3, K=162026.05 | 0.46 | |
| JMCSModel=LLaMA-7B, Score function=Min-K%++, alpha=0.2, K=162026.05 | 0.456 | |
| JECSModel=NeoX-20B, Score function=Min-K%++, alpha=0.1, K=162026.05 | 0.443 | |
| JECSModel=LLaMA-7B, Score function=Perplexity, alpha=0.3, K=162026.05 | 0.439 | |
| JECSModel=LLaMA-7B, Score function=Min-K%++, alpha=0.1, K=162026.05 | 0.4 | |
| JECSModel=NeoX-20B, Score function=Perplexity, alpha=0.2, K=162026.05 | 0.394 | |
| JMCSModel=NeoX-20B, Score function=Min-K%++, alpha=0.1, K=162026.05 | 0.382 | |
| JECSModel=LLaMA-7B, Score function=M-Entropy, alpha=0.3, K=162026.05 | 0.363 | |
| JECSModel=NeoX-20B, Score function=Min-K%, alpha=0.2, K=162026.05 | 0.358 | |
| JMCSModel=NeoX-20B, Score function=Min-K%, alpha=0.3, K=162026.05 | 0.358 | |
| JMCSModel=NeoX-20B, Score function=Perplexity, alpha=0.3, K=162026.05 | 0.326 | |
| JECSModel=LLaMA-7B, Score function=Min-K%, alpha=0.2, K=162026.05 | 0.316 | |
| JECSModel=Pythia-6.9B, Score function=Min-K%, alpha=0.3, K=162026.05 | 0.311 | |
| JMCSModel=LLaMA-7B, Score function=Min-K%, alpha=0.3, K=162026.05 | 0.301 | |
| JECSModel=NeoX-20B, Score function=M-Entropy, alpha=0.2, K=162026.05 | 0.283 | |
| JECSModel=Pythia-6.9B, Score function=Min-K%++, alpha=0.2, K=162026.05 | 0.232 | |
| JMCSModel=NeoX-20B, Score function=M-Entropy, alpha=0.3, K=162026.05 | 0.229 | |
| JMCSModel=Pythia-6.9B, Score function=Min-K%++, alpha=0.3, K=162026.05 | 0.181 | |
| JMCSModel=LLaMA-7B, Score function=Min-K%, alpha=0.2, K=162026.05 | 0.178 | |
| JECSModel=LLaMA-7B, Score function=Perplexity, alpha=0.2, K=162026.05 | 0.171 | |
| JECSModel=Pythia-6.9B, Score function=Perplexity, alpha=0.3, K=162026.05 | 0.168 | |
| JMCSModel=NeoX-20B, Score function=Min-K%, alpha=0.2, K=162026.05 | 0.152 | |
| JECSModel=LLaMA-7B, Score function=Min-K%, alpha=0.1, K=162026.05 | 0.133 | |
| JECSModel=LLaMA-7B, Score function=M-Entropy, alpha=0.2, K=162026.05 | 0.13 | |
| JECSModel=Pythia-6.9B, Score function=M-Entropy, alpha=0.3, K=162026.05 | 0.125 | |
| JMCSModel=LLaMA-7B, Score function=Min-K%++, alpha=0.1, K=162026.05 | 0.12 | |
| JECSModel=NeoX-20B, Score function=Perplexity, alpha=0.1, K=162026.05 | 0.094 | |
| JMCSModel=NeoX-20B, Score function=Perplexity, alpha=0.2, K=162026.05 | 0.089 | |
| JMCSModel=LLaMA-7B, Score function=Perplexity, alpha=0.3, K=162026.05 | 0.088 | |
| JECSModel=NeoX-20B, Score function=Min-K%, alpha=0.1, K=162026.05 | 0.067 | |
| JMCSModel=LLaMA-7B, Score function=M-Entropy, alpha=0.3, K=162026.05 | 0.064 | |
| JECSModel=Pythia-6.9B, Score function=Perplexity, alpha=0.2, K=162026.05 | 0.048 | |
| JMCSModel=Pythia-6.9B, Score function=Perplexity, alpha=0.3, K=162026.05 | 0.043 | |
| JMCSModel=NeoX-20B, Score function=M-Entropy, alpha=0.2, K=162026.05 | 0.041 | |
| JECSModel=Pythia-6.9B, Score function=Min-K%, alpha=0.2, K=162026.05 | 0.036 | |
| JECSModel=Pythia-6.9B, Score function=M-Entropy, alpha=0.2, K=162026.05 | 0.034 | |
| JMCSModel=Pythia-6.9B, Score function=M-Entropy, alpha=0.3, K=162026.05 | 0.031 | |
| JMCSModel=Pythia-6.9B, Score function=Min-K%, alpha=0.3, K=162026.05 | 0.029 | |
| JMCSModel=LLaMA-7B, Score function=Min-K%, alpha=0.1, K=162026.05 | 0.018 | |
| JECSModel=NeoX-20B, Score function=M-Entropy, alpha=0.1, K=162026.05 | 0.017 | |
| JMCSModel=Pythia-6.9B, Score function=Perplexity, alpha=0.2, K=162026.05 | 0.012 | |
| JMCSModel=Pythia-6.9B, Score function=M-Entropy, alpha=0.2, K=162026.05 | 0.011 | |
| JECSModel=LLaMA-7B, Score function=Perplexity, alpha=0.1, K=162026.05 | 0.01 | |
| JMCSModel=LLaMA-7B, Score function=Perplexity, alpha=0.2, K=162026.05 | 0.01 | |
| JMCSModel=Pythia-6.9B, Score function=Min-K%++, alpha=0.2, K=162026.05 | 0.01 | |
| JECSModel=Pythia-6.9B, Score function=Perplexity, alpha=0.1, K=162026.05 | 0.008 | |
| JMCSModel=LLaMA-7B, Score function=M-Entropy, alpha=0.2, K=162026.05 | 0.007 | |
| JMCSModel=NeoX-20B, Score function=Min-K%, alpha=0.1, K=162026.05 | 0.006 | |
| JECSModel=LLaMA-7B, Score function=M-Entropy, alpha=0.1, K=162026.05 | 0.006 | |
| JECSModel=Pythia-6.9B, Score function=M-Entropy, alpha=0.1, K=162026.05 | 0.004 | |
| JECSModel=Pythia-6.9B, Score function=Min-K%++, alpha=0.1, K=162026.05 | 0.003 | |
| JMCSModel=Pythia-6.9B, Score function=Min-K%, alpha=0.2, K=162026.05 | 0.003 | |
| JECSModel=Pythia-6.9B, Score function=Min-K%, alpha=0.1, K=162026.05 | 0.001 | |
| JMCSModel=NeoX-20B, Score function=Perplexity, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=NeoX-20B, Score function=M-Entropy, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=LLaMA-7B, Score function=Perplexity, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=LLaMA-7B, Score function=M-Entropy, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=Pythia-6.9B, Score function=Perplexity, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=Pythia-6.9B, Score function=Min-K%++, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=Pythia-6.9B, Score function=Min-K%, alpha=0.1, K=162026.05 | 0 | |
| JMCSModel=Pythia-6.9B, Score function=M-Entropy, alpha=0.1, K=162026.05 | 0 |