Membership Inference Attack on MIMIR Github (TPR@1%FPR)
26TPR@1%FPRZlib
Evaluation Results
| Method | Links | |
|---|---|---|
| ZlibModel Parameters=6.9B2026.03 | 26 | |
| ZlibModel Parameters=12B2026.03 | 25.8 | |
| ZlibModel Parameters=2.8B2026.03 | 24 | |
| ReproMIAModel Parameters=12B2026.03 | 23.8 | |
| Min-K%++Model Parameters=12B2026.03 | 23.2 | |
| ReproMIAModel Parameters=6.9B2026.03 | 23.2 | |
| LossModel Parameters=12B2026.03 | 23.1 | |
| Min-K%Model Parameters=12B2026.03 | 23.1 | |
| ZlibModel Parameters=1.4B2026.03 | 22.8 | |
| Min-K%Model Parameters=6.9B2026.03 | 22.8 | |
| LossModel Parameters=6.9B2026.03 | 22.6 | |
| ReCaLLModel Parameters=12B2026.03 | 22.3 | |
| LossModel Parameters=2.8B2026.03 | 22.2 | |
| Min-K%Model Parameters=2.8B2026.03 | 21.6 | |
| Min-K%++Model Parameters=6.9B2026.03 | 21 | |
| ReCaLLModel Parameters=2.8B2026.03 | 20.7 | |
| Min-K%Model Parameters=1.4B2026.03 | 20.1 | |
| LossModel Parameters=1.4B2026.03 | 19.6 | |
| ReproMIAModel Parameters=1.4B2026.03 | 19.4 | |
| ReproMIAModel Parameters=2.8B2026.03 | 19.1 | |
| Min-K%++Model Parameters=2.8B2026.03 | 18.8 | |
| ReCaLLModel Parameters=6.9B2026.03 | 18.5 | |
| Min-K%++Model Parameters=1.4B2026.03 | 18.1 | |
| ReCaLLModel Parameters=1.4B2026.03 | 18 | |
| ZlibModel Parameters=160M2026.03 | 17.3 | |
| LossModel Parameters=160M2026.03 | 15.7 | |
| Min-K%Model Parameters=160M2026.03 | 15.2 | |
| Min-K%++Model Parameters=160M2026.03 | 15 | |
| ReproMIAModel Parameters=160M2026.03 | 15 | |
| RefModel Parameters=12B2026.03 | 14.8 | |
| RefModel Parameters=6.9B2026.03 | 14 | |
| RefModel Parameters=160M2026.03 | 13.8 | |
| ReCaLLModel Parameters=160M2026.03 | 11.4 | |
| RefModel Parameters=1.4B2026.03 | 10.8 | |
| RefModel Parameters=2.8B2026.03 | 10.4 |