Membership Inference Attack on Clinicalnotes
0.4253TPR@FPR=0.01HT-MIA
Evaluation Results
| Method | Links | |
|---|---|---|
| HT-MIATarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.4253 | |
| RatioTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.3883 | |
| HT-MIATarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.3839 | |
| LossTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.3148 | |
| RatioTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.2842 | |
| ZlibTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.2663 | |
| LossTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.264 | |
| ZlibTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.2407 | |
| PACTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.2251 | |
| Min-K++Target Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.2168 | |
| PACTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.2143 | |
| LowercaseTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.199 | |
| LowercaseTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.1891 | |
| SPV-MIATarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.133 | |
| Min-K++Target Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 0.0536 | |
| HT-MIATarget Model=GPT-2, Fine-tuned=true2026.01 | 0.0524 | |
| Min-K++Target Model=GPT-2, Fine-tuned=true2026.01 | 0.0279 | |
| LossTarget Model=GPT-2, Fine-tuned=true2026.01 | 0.0223 | |
| RatioTarget Model=GPT-2, Fine-tuned=true2026.01 | 0.0201 | |
| ZlibTarget Model=GPT-2, Fine-tuned=true2026.01 | 0.0174 | |
| LowercaseTarget Model=GPT-2, Fine-tuned=true2026.01 | 0.017 | |
| SPV-MIATarget Model=GPT-2, Fine-tuned=true2026.01 | 0.015 | |
| PACTarget Model=GPT-2, Fine-tuned=true2026.01 | 0.0135 | |
| SPV-MIATarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 0.012 |