Membership Inference Attack on MIMIR Average
74.4AUCLoss
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LossModel Parameters=6.9B, Access Setting=Gray-Box2026.01 | 74.4 | — | |
| LossModel Parameters=2.8B, Access Setting=Gray-Box2026.01 | 74.1 | — | |
| LossModel Parameters=1.4B, Access Setting=Gray-Box2026.01 | 73.5 | — | |
| LossModel Parameters=160M, Access Setting=Gray-Box2026.01 | 72.2 | — | |
| SimMIAModel Parameters=1.4B, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 70.7 | — | |
| SimMIAModel Parameters=2.8B, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 70.7 | — | |
| SimMIAModel Parameters=6.9B, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 70.3 | — | |
| SimMIAModel Parameters=160M, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 69 | — | |
| ReCaLLParameters=6.9B2026.03 | 62.4 | — | |
| ReCaLLParameters=1.4B2026.03 | 60.8 | — | |
| ReCaLLParameters=12B2026.03 | 60.7 | — | |
| Min-K%++Parameters=1.4B2026.03 | 57.5 | — | |
| ReCaLLParameters=2.8B2026.03 | 57.1 | — | |
| ZlibParameters=2.8B2026.03 | 54.4 | — | |
| ReproMIAParameters=6.9B2026.03 | 54.2 | — | |
| ReproMIAParameters=12B2026.03 | 54.2 | — | |
| ZlibParameters=12B2026.03 | 53.9 | — | |
| ZlibParameters=6.9B2026.03 | 53.8 | — | |
| ZlibParameters=160M2026.03 | 53.7 | — | |
| ZlibParameters=1.4B2026.03 | 53.6 | — | |
| Min-K%++Parameters=6.9B2026.03 | 53.4 | — | |
| ReproMIAParameters=2.8B2026.03 | 53.2 | — | |
| ReproMIAParameters=1.4B2026.03 | 52.5 | — | |
| Min-K%++Parameters=12B2026.03 | 50.8 | — | |
| ReproMIAParameters=160M2026.03 | 50.3 | — | |
| ReCaLLParameters=160M2026.03 | 50.2 | — | |
| Min-K%Parameters=6.9B2026.03 | 49.8 | — | |
| Min-K%Parameters=12B2026.03 | 48.6 | — | |
| Min-K%++Parameters=2.8B2026.03 | 48.5 | — | |
| Min-K%Parameters=1.4B2026.03 | 48.4 | — | |
| RefParameters=6.9B2026.03 | 48.2 | — | |
| RefParameters=12B2026.03 | 48 | — | |
| NeighborParameters=1.4B2026.03 | 47.8 | — | |
| NeighborParameters=12B2026.03 | 47.8 | — | |
| RefParameters=1.4B2026.03 | 47.5 | — | |
| NeighborParameters=6.9B2026.03 | 46.8 | — | |
| LossParameters=1.4B2026.03 | 45.7 | — | |
| LossParameters=12B2026.03 | 45 | — | |
| Min-K%++Parameters=160M2026.03 | 44.1 | — | |
| LossParameters=6.9B2026.03 | 43.5 | — | |
| RefParameters=2.8B2026.03 | 40.7 | — | |
| NeighborParameters=2.8B2026.03 | 40.7 | — | |
| Min-K%Parameters=2.8B2026.03 | 40.3 | — | |
| Min-K%Parameters=160M2026.03 | 39.6 | — | |
| LossParameters=160M2026.03 | 39 | — | |
| NeighborParameters=160M2026.03 | 38.1 | — | |
| LossParameters=2.8B2026.03 | 37.7 | — | |
| RefParameters=160M2026.03 | 37.6 | — | |
| LossModel Parameters=160M2026.03 | — | 0.7 | |
| LossModel Parameters=1.4B2026.03 | — | 0.6 | |
| LossModel Parameters=2.8B2026.03 | — | 0.8 | |
| LossModel Parameters=6.9B2026.03 | — | 0.9 | |
| LossModel Parameters=12B2026.03 | — | 1 | |
| Min-K%Model Parameters=160M2026.03 | — | 0.9 | |
| Min-K%Model Parameters=1.4B2026.03 | — | 0.6 | |
| Min-K%Model Parameters=2.8B2026.03 | — | 0.5 | |
| Min-K%Model Parameters=6.9B2026.03 | — | 0.6 | |
| Min-K%Model Parameters=12B2026.03 | — | 0.8 | |
| Min-K%++Model Parameters=160M2026.03 | — | 0.9 | |
| Min-K%++Model Parameters=1.4B2026.03 | — | 0.8 | |
| Min-K%++Model Parameters=2.8B2026.03 | — | 1.2 | |
| Min-K%++Model Parameters=6.9B2026.03 | — | 1.1 | |
| Min-K%++Model Parameters=12B2026.03 | — | 1.2 | |
| ReCaLLModel Parameters=160M2026.03 | — | 0.8 | |
| ReCaLLModel Parameters=1.4B2026.03 | — | 1 | |
| ReCaLLModel Parameters=2.8B2026.03 | — | 0.9 | |
| ReCaLLModel Parameters=6.9B2026.03 | — | 1.1 | |
| ReCaLLModel Parameters=12B2026.03 | — | 1.2 | |
| RefModel Parameters=160M2026.03 | — | 1.1 | |
| RefModel Parameters=1.4B2026.03 | — | 1.3 | |
| RefModel Parameters=2.8B2026.03 | — | 1.3 | |
| RefModel Parameters=6.9B2026.03 | — | 1.2 | |
| RefModel Parameters=12B2026.03 | — | 1.3 | |
| ReproMIAModel Parameters=160M2026.03 | — | 0.9 | |
| ReproMIAModel Parameters=1.4B2026.03 | — | 1.9 | |
| ReproMIAModel Parameters=2.8B2026.03 | — | 1.9 | |
| ReproMIAModel Parameters=6.9B2026.03 | — | 1.8 | |
| ReproMIAModel Parameters=12B2026.03 | — | 1.8 | |
| ZlibModel Parameters=160M2026.03 | — | 0.9 | |
| ZlibModel Parameters=1.4B2026.03 | — | 0.7 | |
| ZlibModel Parameters=2.8B2026.03 | — | 0.8 | |
| ZlibModel Parameters=6.9B2026.03 | — | 0.9 | |
| ZlibModel Parameters=12B2026.03 | — | 1 |