List your company
ResearchFormerly WizWand

Membership Inference Attack on WikiMIA length 256

0.8AUC (MIA)SaMIA
0.540.60750.6750.7425Apr 17, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SaMIATarget LLM=OPT-6.7B2024.040.8
SaMIA*zlibTarget LLM=OPT-6.7B2024.040.8
SaMIA*zlibTarget LLM=GPT-J-6B2024.040.79
SaMIATarget LLM=GPT-J-6B2024.040.77
SaMIA*zlibTarget LLM=Pythia-6.9B2024.040.74
SaMIATarget LLM=Pythia-6.9B2024.040.73
Min-K% ProbTarget LLM=GPT-J-6B2024.040.71
Min-K% ProbTarget LLM=Pythia-6.9B2024.040.71
SaMIATarget LLM=LLAMA-2-7B2024.040.71
PPL/zlibTarget LLM=Pythia-6.9B2024.040.7
LOSSTarget LLM=GPT-J-6B2024.040.69
PPL/zlibTarget LLM=GPT-J-6B2024.040.69
SaMIA*zlibTarget LLM=LLAMA-2-7B2024.040.69
LOSSTarget LLM=Pythia-6.9B2024.040.68
Min-K% ProbTarget LLM=OPT-6.7B2024.040.67
PPL/zlibTarget LLM=OPT-6.7B2024.040.65
LOSSTarget LLM=OPT-6.7B2024.040.64
LowercaseTarget LLM=GPT-J-6B2024.040.6
LowercaseTarget LLM=OPT-6.7B2024.040.59
LOSSTarget LLM=LLAMA-2-7B2024.040.59
PPL/zlibTarget LLM=LLAMA-2-7B2024.040.59
LowercaseTarget LLM=LLAMA-2-7B2024.040.59
Min-K% ProbTarget LLM=LLAMA-2-7B2024.040.58
LowercaseTarget LLM=Pythia-6.9B2024.040.55