List your company
ResearchFormerly WizWand

Membership Inference Attack on WikiMIA

71AUCSaMIA*zlib
51.2456.3761.566.63Apr 17, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SaMIA*zlibTarget LLM=OPT-6.7B, Likelihood dependency=likelihood-independent2024.047137.3
Min-K% ProbTarget LLM=GPT-J-6B, Likelihood dependency=likelihood-dependent2024.046926.8
Min-K% ProbTarget LLM=Pythia-6.9B, Likelihood dependency=likelihood-dependent2024.046826.6
LOSSTarget LLM=GPT-J-6B, Likelihood dependency=likelihood-dependent2024.046618
PPL/zlibTarget LLM=GPT-J-6B, Likelihood dependency=likelihood-dependent2024.046621.3
SaMIA*zlibTarget LLM=GPT-J-6B, Likelihood dependency=likelihood-independent2024.046626
SaMIATarget LLM=OPT-6.7B, Likelihood dependency=likelihood-independent2024.046631.8
PPL/zlibTarget LLM=Pythia-6.9B, Likelihood dependency=likelihood-dependent2024.046619.6
SaMIA*zlibTarget LLM=Pythia-6.9B, Likelihood dependency=likelihood-independent2024.046623.7
LOSSTarget LLM=Pythia-6.9B, Likelihood dependency=likelihood-dependent2024.046520.4
SaMIATarget LLM=GPT-J-6B, Likelihood dependency=likelihood-independent2024.046419.9
Min-K% ProbTarget LLM=OPT-6.7B, Likelihood dependency=likelihood-dependent2024.046425.8
SaMIATarget LLM=Pythia-6.9B, Likelihood dependency=likelihood-independent2024.046420.4
PPL/zlibTarget LLM=OPT-6.7B, Likelihood dependency=likelihood-dependent2024.046217.5
SaMIA*zlibTarget LLM=LLAMA-2-7B, Likelihood dependency=likelihood-independent2024.046220
LOSSTarget LLM=OPT-6.7B, Likelihood dependency=likelihood-dependent2024.046116.8
SaMIATarget LLM=LLAMA-2-7B, Likelihood dependency=likelihood-independent2024.046016.4
LowercaseTarget LLM=GPT-J-6B, Likelihood dependency=likelihood-dependent2024.045916.7
LowercaseTarget LLM=OPT-6.7B, Likelihood dependency=likelihood-dependent2024.045816
LowercaseTarget LLM=Pythia-6.9B, Likelihood dependency=likelihood-dependent2024.045717
PPL/zlibTarget LLM=LLAMA-2-7B, Likelihood dependency=likelihood-dependent2024.045616.1
LOSSTarget LLM=LLAMA-2-7B, Likelihood dependency=likelihood-dependent2024.045513.8
Min-K% ProbTarget LLM=LLAMA-2-7B, Likelihood dependency=likelihood-dependent2024.045410.7
LowercaseTarget LLM=LLAMA-2-7B, Likelihood dependency=likelihood-dependent2024.045215.5