Membership Inference Attack on MIMIR HackerNews
2TPR@1%FPRReCaLL
Evaluation results
| Method | Links | |
|---|---|---|
| ReCaLLModel Parameters=6.9B2026.03 | 2 | |
| ReproMIAModel Parameters=1.4B2026.03 | 2 | |
| ReproMIAModel Parameters=6.9B2026.03 | 2 | |
| ReCaLLModel Parameters=1.4B2026.03 | 1.9 | |
| ReCaLLModel Parameters=160M2026.03 | 1.8 | |
| ReproMIAModel Parameters=2.8B2026.03 | 1.7 | |
| ReproMIAModel Parameters=12B2026.03 | 1.6 | |
| RefModel Parameters=160M2026.03 | 1.5 | |
| ReCaLLModel Parameters=2.8B2026.03 | 1.5 | |
| ZlibModel Parameters=6.9B2026.03 | 1.3 | |
| Min-K%Model Parameters=160M2026.03 | 1.3 | |
| Min-K%++Model Parameters=6.9B2026.03 | 1.3 | |
| RefModel Parameters=1.4B2026.03 | 1.2 | |
| RefModel Parameters=2.8B2026.03 | 1.2 | |
| RefModel Parameters=6.9B2026.03 | 1.2 | |
| RefModel Parameters=12B2026.03 | 1.2 | |
| ZlibModel Parameters=12B2026.03 | 1.2 | |
| ZlibModel Parameters=160M2026.03 | 1 | |
| ZlibModel Parameters=2.8B2026.03 | 1 | |
| Min-K%++Model Parameters=2.8B2026.03 | 1 | |
| LossModel Parameters=160M2026.03 | 0.9 | |
| ZlibModel Parameters=1.4B2026.03 | 0.9 | |
| Min-K%Model Parameters=6.9B2026.03 | 0.9 | |
| Min-K%Model Parameters=12B2026.03 | 0.9 | |
| Min-K%++Model Parameters=160M2026.03 | 0.9 | |
| ReproMIAModel Parameters=160M2026.03 | 0.9 | |
| LossModel Parameters=6.9B2026.03 | 0.8 | |
| LossModel Parameters=12B2026.03 | 0.8 | |
| Min-K%Model Parameters=1.4B2026.03 | 0.8 | |
| Min-K%++Model Parameters=12B2026.03 | 0.8 | |
| ReCaLLModel Parameters=12B2026.03 | 0.8 | |
| Min-K%Model Parameters=2.8B2026.03 | 0.7 | |
| LossModel Parameters=1.4B2026.03 | 0.6 | |
| LossModel Parameters=2.8B2026.03 | 0.6 | |
| Min-K%++Model Parameters=1.4B2026.03 | 0.4 |