Membership Inference Attack on HealthcareMagic
94.2AUCICP-MIA-SP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ICP-MIA-SPTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 94.2 | 17.2 | |
| Reference Attack (Ref)Target Model=LLaMA-3.2-3B-Instruct2025.12 | 87 | 1.2 | |
| ICP-MIA-SPTarget Model=Pythia-2.8B-deduped2025.12 | 85.3 | 12.2 | |
| ICP-MIA-RefTarget Model=Pythia-2.8B-deduped2025.12 | 85 | 11 | |
| RecallTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 84.7 | 2.4 | |
| ICP-MIA-RefTarget Model=LLaMA-3.2-3B2025.12 | 84.2 | 14 | |
| Min-K%Target Model=LLaMA-3.2-3B-Instruct2025.12 | 83.7 | 4.6 | |
| ICP-MIA-RefTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 82.7 | 8.4 | |
| Reference Attack (Ref)Target Model=LLaMA-3.2-3B2025.12 | 81.7 | 1 | |
| Reference Attack (Ref)Target Model=Pythia-2.8B-deduped2025.12 | 79.9 | 1 | |
| Min-K%++Target Model=LLaMA-3.2-3B-Instruct2025.12 | 79.8 | 3.4 | |
| Reference Attack (Base)Target Model=LLaMA-3.2-3B-Instruct2025.12 | 79.6 | 1.8 | |
| SPV-MIATarget Model=LLaMA-3.2-3B-Instruct2025.12 | 78.1 | 3.4 | |
| RecallTarget Model=LLaMA-3.2-3B2025.12 | 78 | 1.4 | |
| Min-K%Target Model=Pythia-2.8B-deduped2025.12 | 77.7 | 2.2 | |
| Loss AttackTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 77 | 4.2 | |
| RecallTarget Model=Pythia-2.8B-deduped2025.12 | 76.8 | 2 | |
| ZlibTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 76.5 | 3.6 | |
| Min-K%Target Model=LLaMA-3.2-3B2025.12 | 76.3 | 2.4 | |
| ICP-MIA-SPTarget Model=LLaMA-3.2-3B2025.12 | 76.3 | 7 | |
| Reference Attack (Base)Target Model=LLaMA-3.2-3B2025.12 | 73.6 | 2.6 | |
| Min-K%++Target Model=Pythia-2.8B-deduped2025.12 | 72.7 | 1.6 | |
| SPV-MIATarget Model=LLaMA-3.2-3B2025.12 | 72.5 | 3.6 | |
| Reference Attack (Base)Target Model=Pythia-2.8B-deduped2025.12 | 71.7 | 1.6 | |
| SPV-MIATarget Model=Pythia-2.8B-deduped2025.12 | 71.3 | 2 | |
| Min-K%++Target Model=LLaMA-3.2-3B2025.12 | 71 | 0.4 | |
| Loss AttackTarget Model=LLaMA-3.2-3B2025.12 | 70.8 | 2.8 | |
| ZlibTarget Model=LLaMA-3.2-3B2025.12 | 70.3 | 3.4 | |
| Loss AttackTarget Model=Pythia-2.8B-deduped2025.12 | 70.1 | 2 | |
| ZlibTarget Model=Pythia-2.8B-deduped2025.12 | 69.4 | 0.6 | |
| NeighborhoodTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 66.9 | 3.2 | |
| NeighborhoodTarget Model=Pythia-2.8B-deduped2025.12 | 63.5 | 1.8 | |
| NeighborhoodTarget Model=LLaMA-3.2-3B2025.12 | 61.4 | 1.4 | |
| Bag of WordsTarget Model=Pythia-2.8B-deduped2025.12 | 50.1 | 0.3 | |
| Bag of WordsTarget Model=LLaMA-3.2-3B2025.12 | 49.1 | 1.4 | |
| Bag of WordsTarget Model=LLaMA-3.2-3B-Instruct2025.12 | 48.5 | 0.8 |