Membership Inference Attack on MovieLens
91.71AccuracyPPL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| PPLModel=LLaMA32025.09 | 91.71 | 50.25 | 66.89 | 34.2 | |
| MIA4LLMRSTarget Model=T5-base2025.09 | 85 | 93.75 | 86.21 | 90.14 | |
| min-k%Model=LLaMA32025.09 | 80.04 | 90.04 | 64.99 | 49.32 | |
| min-k%++Model=LLaMA32025.09 | 74.5 | 67.72 | 53.5 | 9.13 | |
| PPLModel=T52025.09 | 62.33 | 74.5 | 28.42 | 48.94 | |
| PPLTarget Model=T5-base2025.09 | 62.33 | 74.5 | 28.42 | 48.94 | |
| ShadowTarget Model=T5-base2025.09 | 60 | 55 | 57.89 | 67.74 | |
| PPLModel=GPT-22025.09 | 56.33 | 51.5 | 28.22 | 39.31 | |
| ZlibTarget Model=T5-base2025.09 | 53.21 | 49 | 25.87 | 51.9 | |
| min-k%++Model=GPT-22025.09 | 52.5 | 51.9 | 51.25 | 48.12 | |
| min-k%Model=T52025.09 | 51.46 | 44.25 | 23.3 | 49.9 | |
| min-k%Target Model=T5-base2025.09 | 51.46 | 44.25 | 23.3 | 49.9 | |
| min-k%Model=GPT-22025.09 | 41.71 | 80.25 | 31.46 | 39.29 | |
| min-k%++Model=T52025.09 | 26.87 | 39.75 | 35.22 | 85.98 | |
| min-k%++Target Model=T5-base2025.09 | 26.87 | 39.75 | 35.22 | 85.98 |