Membership Inference Attack on CNN-DM
0.974AUCSPV-MIA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPV-MIATarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.974 | 60.2 | |
| Reference Attack (Ref)Target Model=LLaMA-3.2-3B-Instruct2025.12 | 0.971 | 38.8 | |
| ICP-MIA-SPTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.965 | 51.8 | |
| SPV-MIATarget Model=LLaMA-3.2-3B2025.12 | 0.959 | 44 | |
| SPV-MIATarget Model=Pythia-2.8B-deduped2025.12 | 0.938 | 53.1 | |
| Reference Attack (Ref)Target Model=LLaMA-3.2-3B2025.12 | 0.937 | 41.2 | |
| ZlibTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.932 | 5.8 | |
| Min-K%Target Model=LLaMA-3.2-3B-Instruct2025.12 | 0.93 | 10.4 | |
| RecallTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.93 | 19.5 | |
| Loss AttackTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.929 | 8.8 | |
| ICP-MIA-SPTarget Model=LLaMA-3.2-3B2025.12 | 0.927 | 41.8 | |
| Reference Attack (Base)Target Model=LLaMA-3.2-3B-Instruct2025.12 | 0.925 | 35.4 | |
| Reference Attack (Ref)Target Model=Pythia-2.8B-deduped2025.12 | 0.919 | 39 | |
| Min-K%Target Model=LLaMA-3.2-3B2025.12 | 0.89 | 9 | |
| ICP-MIA-RefTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.89 | 2 | |
| ZlibTarget Model=LLaMA-3.2-3B2025.12 | 0.888 | 4.2 | |
| Loss AttackTarget Model=LLaMA-3.2-3B2025.12 | 0.885 | 3.4 | |
| RecallTarget Model=LLaMA-3.2-3B2025.12 | 0.884 | 9.6 | |
| Reference Attack (Base)Target Model=LLaMA-3.2-3B2025.12 | 0.871 | 27 | |
| Min-K%++Target Model=LLaMA-3.2-3B-Instruct2025.12 | 0.861 | 11.6 | |
| Min-K%Target Model=Pythia-2.8B-deduped2025.12 | 0.859 | 4.6 | |
| ZlibTarget Model=Pythia-2.8B-deduped2025.12 | 0.856 | 3.4 | |
| Reference Attack (Base)Target Model=Pythia-2.8B-deduped2025.12 | 0.856 | 19.1 | |
| Loss AttackTarget Model=Pythia-2.8B-deduped2025.12 | 0.851 | 2 | |
| ICP-MIA-SPTarget Model=Pythia-2.8B-deduped2025.12 | 0.845 | 14.4 | |
| ICP-MIA-RefTarget Model=LLaMA-3.2-3B2025.12 | 0.837 | 6.2 | |
| RecallTarget Model=Pythia-2.8B-deduped2025.12 | 0.82 | 10.8 | |
| Min-K%++Target Model=LLaMA-3.2-3B2025.12 | 0.794 | 2.8 | |
| Min-K%++Target Model=Pythia-2.8B-deduped2025.12 | 0.76 | 1 | |
| ICP-MIA-RefTarget Model=Pythia-2.8B-deduped2025.12 | 0.706 | 2.2 | |
| NeighborhoodTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.661 | 1.2 | |
| NeighborhoodTarget Model=Pythia-2.8B-deduped2025.12 | 0.627 | 0.6 | |
| NeighborhoodTarget Model=LLaMA-3.2-3B2025.12 | 0.621 | 0.8 | |
| Bag of WordsTarget Model=LLaMA-3.2-3B2025.12 | 0.536 | 0.2 | |
| Bag of WordsTarget Model=Pythia-2.8B-deduped2025.12 | 0.516 | 0.8 | |
| Bag of WordsTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 0.502 | 0.4 |