Membership Inference Attack on Asclepius (fine-tuned)
8.17TPR@FPR=0.01HT-MIA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HT-MIATarget Model=LLaMA-3.2-1B2026.01 | 8.17 | 73.48 | 37.07 | |
| HT-MIATarget Model=LLaMA-3.2-1B2026.01 | 8.17 | — | — | |
| HT-MIATarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 8.17 | 73.48 | 37.07 | |
| HT-MIATarget Model=Qwen-3-0.6B2026.01 | 4.77 | 73.12 | 31.29 | |
| HT-MIATarget Model=Qwen-3-0.6B2026.01 | 4.77 | — | — | |
| HT-MIATarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 4.77 | 73.12 | 31.29 | |
| SPV-MIATarget Model=Qwen-3-0.6B2026.01 | 4.1 | — | — | |
| SPV-MIATarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 4.1 | 64.91 | 27.2 | |
| RatioTarget Model=LLaMA-3.2-1B2026.01 | 2.71 | 67.49 | 23.3 | |
| RatioTarget Model=LLaMA-3.2-1B2026.01 | 2.71 | — | — | |
| RatioTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 2.71 | 67.49 | 23.3 | |
| RatioTarget Model=Qwen-3-0.6B2026.01 | 2.5 | — | — | |
| RatioTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 2.5 | 68.19 | 22.05 | |
| LowercaseTarget Model=LLaMA-3.2-1B2026.01 | 2.47 | 61.37 | 17.96 | |
| LowercaseTarget Model=LLaMA-3.2-1B2026.01 | 2.47 | — | — | |
| LowercaseTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 2.47 | 61.37 | 17.96 | |
| ZlibTarget Model=LLaMA-3.2-1B2026.01 | 2.39 | 63.8 | 19.77 | |
| ZlibTarget Model=LLaMA-3.2-1B2026.01 | 2.39 | — | — | |
| ZlibTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 2.39 | 63.8 | 19.77 | |
| LowercaseTarget Model=Qwen-3-0.6B2026.01 | 2.36 | — | — | |
| LowercaseTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 2.36 | 61.66 | 17.99 | |
| LossTarget Model=LLaMA-3.2-1B2026.01 | 2.28 | 63.32 | 19.7 | |
| LossTarget Model=LLaMA-3.2-1B2026.01 | 2.28 | — | — | |
| LossTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 2.28 | 63.32 | 19.7 | |
| ZlibTarget Model=Qwen-3-0.6B2026.01 | 2.25 | — | — | |
| ZlibTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 2.25 | 63.65 | 19.05 | |
| LossTarget Model=Qwen-3-0.6B2026.01 | 2.2 | — | — | |
| LossTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 2.2 | 63.22 | 18.88 | |
| SPV-MIATarget Model=LLaMA-3.2-1B2026.01 | 2.1 | 63.99 | 21.7 | |
| SPV-MIATarget Model=LLaMA-3.2-1B2026.01 | 2.1 | — | — | |
| SPV-MIATarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 2.1 | 63.99 | 21.7 | |
| PACTarget Model=Qwen-3-0.6B2026.01 | 1.94 | — | — | |
| PACTarget Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 1.94 | 62.25 | 17.75 | |
| PACTarget Model=LLaMA-3.2-1B2026.01 | 1.89 | 61.56 | 17.34 | |
| PACTarget Model=LLaMA-3.2-1B2026.01 | 1.89 | — | — | |
| PACTarget Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 1.89 | 61.56 | 17.34 | |
| Min-K++Target Model=LLaMA-3.2-1B2026.01 | 1.82 | 60.84 | 16.23 | |
| Min-K++Target Model=LLaMA-3.2-1B2026.01 | 1.82 | — | — | |
| Min-K++Target Model=LLaMA-3.2-1B, Fine-tuned=true2026.01 | 1.82 | 60.84 | 16.23 | |
| HT-MIATarget Model=GPT-22026.01 | 1.81 | 56.79 | 11.09 | |
| HT-MIATarget Model=GPT-22026.01 | 1.81 | — | — | |
| HT-MIATarget Model=GPT-2, Fine-tuned=true2026.01 | 1.81 | 56.79 | 11.09 | |
| Min-K++Target Model=Qwen-3-0.6B2026.01 | 1.49 | — | — | |
| Min-K++Target Model=Qwen-3-0.6B, Fine-tuned=true2026.01 | 1.49 | 61.03 | 15.45 | |
| LowercaseTarget Model=GPT-22026.01 | 1.44 | — | — | |
| LowercaseTarget Model=GPT-2, Fine-tuned=true2026.01 | 1.44 | 54.31 | 12.54 | |
| LossTarget Model=GPT-22026.01 | 1.31 | — | — | |
| ZlibTarget Model=GPT-22026.01 | 1.31 | — | — | |
| LossTarget Model=GPT-2, Fine-tuned=true2026.01 | 1.31 | 53.47 | 12.02 | |
| ZlibTarget Model=GPT-2, Fine-tuned=true2026.01 | 1.31 | 53.66 | 12.07 | |
| Min-K++Target Model=GPT-22026.01 | 1.27 | — | — | |
| Min-K++Target Model=GPT-2, Fine-tuned=true2026.01 | 1.27 | 53.24 | 11.51 | |
| RatioTarget Model=GPT-22026.01 | 1.2 | — | — | |
| RatioTarget Model=GPT-2, Fine-tuned=true2026.01 | 1.2 | 53.32 | 11.7 | |
| PACTarget Model=GPT-22026.01 | 1.16 | — | — | |
| PACTarget Model=GPT-2, Fine-tuned=true2026.01 | 1.16 | 53 | 11.57 | |
| SPV-MIATarget Model=GPT-22026.01 | 0.9 | — | — | |
| SPV-MIATarget Model=GPT-2, Fine-tuned=true2026.01 | 0.9 | 54.45 | 13.1 |