Membership Inference Attack on ArxivMIA
8.6TPR@5%FPRProbe Attack (Probe w. Synthetic Data)
Evaluation results
| Method | Links | |
|---|---|---|
| Probe Attack (Probe w. Synthetic Data)Target Model=TinyLLaMA2024.06 | 8.6 | |
| Smaller ModelTarget Model=OpenLLaMA2024.06 | 8.5 | |
| Probe Attack (Probe w. Real Data)Target Model=TinyLLaMA2024.06 | 7.5 | |
| Probe Attack (Probe w. Real Data)Target Model=OpenLLaMA2024.06 | 7.4 | |
| Neighbor AttackTarget Model=OpenLLaMA2024.06 | 7.3 | |
| Probe Attack (Probe w. Synthetic Data)Target Model=OpenLLaMA2024.06 | 6.8 | |
| Neighbor AttackTarget Model=TinyLLaMA2024.06 | 6.5 | |
| Lowercased TextTarget Model=OpenLLaMA2024.06 | 6.3 | |
| Loss AttackTarget Model=OpenLLaMA2024.06 | 5.6 | |
| Loss AttackTarget Model=TinyLLaMA2024.06 | 5.1 | |
| Min-K% ProbTarget Model=OpenLLaMA2024.06 | 5.1 | |
| Min-K% ProbTarget Model=TinyLLaMA2024.06 | 4.5 | |
| Lowercased TextTarget Model=TinyLLaMA2024.06 | 4.3 | |
| Zlib CompressionTarget Model=OpenLLaMA2024.06 | 3.5 | |
| Zlib CompressionTarget Model=TinyLLaMA2024.06 | 2.5 |