Membership Inference Attack on The Pile
0.927AUROCS-ReCaLL
Evaluation results
| Method | Links | |
|---|---|---|
| S-ReCaLLTarget Backbone=Qwen-2.5-1.5B, Fine-tuned status=true2025.12 | 0.927 | |
| High ConfidenceTarget Backbone=Qwen-2.5-1.5B, Fine-tuned status=true2025.12 | 0.921 | |
| SURPTarget Backbone=Qwen-2.5-1.5B, Fine-tuned status=true, k=0.42025.12 | 0.917 | |
| LikelihoodTarget Backbone=Qwen-2.5-1.5B, Fine-tuned status=true2025.12 | 0.913 | |
| Zlib EntropyTarget Backbone=Qwen-2.5-1.5B, Fine-tuned status=true2025.12 | 0.912 | |
| High ConfidenceTarget Backbone=Llama-3.2-1B, Fine-tuned status=true2025.12 | 0.908 | |
| LikelihoodTarget Backbone=Llama-3.2-1B, Fine-tuned status=true2025.12 | 0.906 | |
| Zlib EntropyTarget Backbone=Llama-3.2-1B, Fine-tuned status=true2025.12 | 0.905 | |
| SURPTarget Backbone=Llama-3.2-1B, Fine-tuned status=true, k=0.42025.12 | 0.894 | |
| Min-K%Target Backbone=Llama-3.2-1B, Fine-tuned status=true, k=0.22025.12 | 0.892 | |
| Min-K%Target Backbone=Qwen-2.5-1.5B, Fine-tuned status=true, k=0.22025.12 | 0.873 | |
| S-ReCaLLTarget Backbone=Llama-3.2-1B, Fine-tuned status=true2025.12 | 0.871 | |
| Min-K%++Target Backbone=Llama-3.2-1B, Fine-tuned status=true, k=0.22025.12 | 0.868 | |
| Min-K%++Target Backbone=Qwen-2.5-1.5B, Fine-tuned status=true, k=0.22025.12 | 0.749 |