Membership Inference Attack on MIMIR HackerNews (AUC)
56.3AUCReproMIA
Evaluation Results
| Method | Links | |
|---|---|---|
| ReproMIAParameters=12B2026.03 | 56.3 | |
| ReCaLLParameters=12B2026.03 | 55 | |
| RefParameters=12B2026.03 | 54.6 | |
| Min-K%++Parameters=12B2026.03 | 54.6 | |
| ReproMIAParameters=6.9B2026.03 | 54.6 | |
| Min-K%Parameters=12B2026.03 | 54.3 | |
| RefParameters=6.9B2026.03 | 54.2 | |
| ReCaLLParameters=6.9B2026.03 | 54.2 | |
| Min-K%++Parameters=6.9B2026.03 | 53.8 | |
| ReCaLLParameters=2.8B2026.03 | 53.4 | |
| Min-K%Parameters=6.9B2026.03 | 53.3 | |
| RefParameters=53.02026.03 | 53 | |
| ReproMIAParameters=2.8B2026.03 | 53 | |
| LossParameters=12B2026.03 | 52.6 | |
| NeighborParameters=12B2026.03 | 52.5 | |
| Min-K%++Parameters=2.8B2026.03 | 52.4 | |
| ReproMIAParameters=1.4B2026.03 | 52.2 | |
| Min-K%Parameters=2.8B2026.03 | 52 | |
| LossParameters=6.9B2026.03 | 51.8 | |
| NeighborParameters=6.9B2026.03 | 51.8 | |
| ReCaLLParameters=1.4B2026.03 | 51.8 | |
| ReCaLLParameters=160M2026.03 | 51.5 | |
| ZlibParameters=12B2026.03 | 51.2 | |
| NeighborParameters=2.8B2026.03 | 51.1 | |
| Min-K%++Parameters=1.4B2026.03 | 51.1 | |
| LossParameters=2.8B2026.03 | 51 | |
| RefParameters=1.4B2026.03 | 50.9 | |
| Min-K%Parameters=160M2026.03 | 50.8 | |
| Min-K%Parameters=1.4B2026.03 | 50.8 | |
| ZlibParameters=6.9B2026.03 | 50.6 | |
| ZlibParameters=2.8B2026.03 | 50.4 | |
| NeighborParameters=1.4B2026.03 | 50.4 | |
| LossParameters=1.4B2026.03 | 50.3 | |
| Min-K%++Parameters=160M2026.03 | 50.1 | |
| ReproMIAParameters=160M2026.03 | 50.1 | |
| ZlibParameters=1.4B2026.03 | 49.9 | |
| LossParameters=160M2026.03 | 49.8 | |
| ZlibParameters=160M2026.03 | 49.6 | |
| NeighborParameters=160M2026.03 | 48.3 | |
| RefParameters=160M2026.03 | 43.2 |