Membership Inference Attack on MIMIR Github
91.2AUCZlib
Evaluation results
| Method | Links | |
|---|---|---|
| ZlibModel Parameters=2.8B, Access Setting=Gray-Box2026.01 | 91.2 | |
| ZlibModel Parameters=6.9B, Access Setting=Gray-Box2026.01 | 90.9 | |
| ZlibModel Parameters=1.4B, Access Setting=Gray-Box2026.01 | 89.8 | |
| LossModel Parameters=2.8B, Access Setting=Gray-Box2026.01 | 88.4 | |
| LossModel Parameters=6.9B, Access Setting=Gray-Box2026.01 | 87.9 | |
| ZlibModel Parameters=160M, Access Setting=Gray-Box2026.01 | 87.9 | |
| LossModel Parameters=1.4B, Access Setting=Gray-Box2026.01 | 86.4 | |
| SimMIAModel Parameters=2.8B, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 86.1 | |
| SimMIAModel Parameters=1.4B, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 83.8 | |
| SimMIAModel Parameters=6.9B, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 83.7 | |
| LossModel Parameters=160M, Access Setting=Gray-Box2026.01 | 83.6 | |
| SimMIAModel Parameters=160M, Access Setting=Black-Box, Scoring Function=Eq. 32026.01 | 81.1 | |
| ReCaLLParameters=12B2026.03 | 74.8 | |
| ZlibParameters=12B2026.03 | 74.6 | |
| ReproMIAParameters=12B2026.03 | 74.3 | |
| Min-K%Parameters=12B2026.03 | 73.9 | |
| Min-K%++Parameters=12B2026.03 | 73.8 | |
| LossParameters=12B2026.03 | 73.6 | |
| NeighborParameters=12B2026.03 | 73.5 | |
| Min-K%Parameters=6.9B2026.03 | 72.8 | |
| ZlibParameters=6.9B2026.03 | 72.7 | |
| NeighborParameters=6.9B2026.03 | 72.7 | |
| LossParameters=6.9B2026.03 | 72.6 | |
| Min-K%++Parameters=6.9B2026.03 | 72.4 | |
| ReCaLLParameters=6.9B2026.03 | 72.2 | |
| ZlibParameters=2.8B2026.03 | 72 | |
| ReproMIAParameters=6.9B2026.03 | 71.9 | |
| ReCaLLParameters=2.8B2026.03 | 71.3 | |
| NeighborParameters=2.8B2026.03 | 71.1 | |
| Min-K%Parameters=2.8B2026.03 | 71 | |
| ZlibParameters=1.4B2026.03 | 70.9 | |
| LossParameters=2.8B2026.03 | 70.8 | |
| Min-K%++Parameters=2.8B2026.03 | 70.5 | |
| NeighborParameters=1.4B2026.03 | 70.3 | |
| Min-K%Parameters=1.4B2026.03 | 69.8 | |
| LossParameters=1.4B2026.03 | 69.6 | |
| Min-K%++Parameters=1.4B2026.03 | 69.5 | |
| ReproMIAParameters=2.8B2026.03 | 69.1 | |
| ReCaLLParameters=1.4B2026.03 | 69 | |
| RefParameters=12B2026.03 | 67.7 | |
| RefParameters=6.9B2026.03 | 67.2 | |
| ZlibParameters=160M2026.03 | 67.2 | |
| NeighborParameters=160M2026.03 | 67.1 | |
| ReproMIAParameters=1.4B2026.03 | 66.5 | |
| RefParameters=2.8B2026.03 | 66.4 | |
| RefParameters=1.4B2026.03 | 65.6 | |
| ReCaLLParameters=160M2026.03 | 65.3 | |
| LossParameters=160M2026.03 | 65.2 | |
| Min-K%++Parameters=160M2026.03 | 65.1 | |
| ReproMIAParameters=160M2026.03 | 65.1 | |
| Min-K%Parameters=160M2026.03 | 65 | |
| RefParameters=160M2026.03 | 63.5 |