Membership Inference Attack on WikiMIA length 256
0.8AUC (MIA)SaMIA
Evaluation Results
| Method | Links | |
|---|---|---|
| SaMIATarget LLM=OPT-6.7B2024.04 | 0.8 | |
| SaMIA*zlibTarget LLM=OPT-6.7B2024.04 | 0.8 | |
| SaMIA*zlibTarget LLM=GPT-J-6B2024.04 | 0.79 | |
| SaMIATarget LLM=GPT-J-6B2024.04 | 0.77 | |
| SaMIA*zlibTarget LLM=Pythia-6.9B2024.04 | 0.74 | |
| SaMIATarget LLM=Pythia-6.9B2024.04 | 0.73 | |
| Min-K% ProbTarget LLM=GPT-J-6B2024.04 | 0.71 | |
| Min-K% ProbTarget LLM=Pythia-6.9B2024.04 | 0.71 | |
| SaMIATarget LLM=LLAMA-2-7B2024.04 | 0.71 | |
| PPL/zlibTarget LLM=Pythia-6.9B2024.04 | 0.7 | |
| LOSSTarget LLM=GPT-J-6B2024.04 | 0.69 | |
| PPL/zlibTarget LLM=GPT-J-6B2024.04 | 0.69 | |
| SaMIA*zlibTarget LLM=LLAMA-2-7B2024.04 | 0.69 | |
| LOSSTarget LLM=Pythia-6.9B2024.04 | 0.68 | |
| Min-K% ProbTarget LLM=OPT-6.7B2024.04 | 0.67 | |
| PPL/zlibTarget LLM=OPT-6.7B2024.04 | 0.65 | |
| LOSSTarget LLM=OPT-6.7B2024.04 | 0.64 | |
| LowercaseTarget LLM=GPT-J-6B2024.04 | 0.6 | |
| LowercaseTarget LLM=OPT-6.7B2024.04 | 0.59 | |
| LOSSTarget LLM=LLAMA-2-7B2024.04 | 0.59 | |
| PPL/zlibTarget LLM=LLAMA-2-7B2024.04 | 0.59 | |
| LowercaseTarget LLM=LLAMA-2-7B2024.04 | 0.59 | |
| Min-K% ProbTarget LLM=LLAMA-2-7B2024.04 | 0.58 | |
| LowercaseTarget LLM=Pythia-6.9B2024.04 | 0.55 |