Membership Inference on Pokemon
97.96ASRCLiDth
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CLiDthQuery=15, Training Setting=Over-training2024.05 | 97.96 | 0.9928 | 97.84 | |
| CLiDvecQuery=15, Training Setting=Over-training2024.05 | 97.36 | 0.9946 | 96.88 | |
| PFAMIQuery=20, Training Setting=Over-training2024.05 | 89.86 | 0.957 | 65.35 | |
| Naive+FHigh-Frequency Filter=Enabled2025.05 | 87.88 | 0.9414 | 41.25 | |
| LossQuery=1, Training Setting=Over-training2024.05 | 83.76 | 0.9179 | 25.77 | |
| SecMI+FHigh-Frequency Filter=Enabled2025.05 | 83.75 | 0.8973 | 31.25 | |
| PIAQuery=2, Training Setting=Over-training2024.05 | 83.37 | 0.9095 | 13.31 | |
| PIA+FHigh-Frequency Filter=Enabled2025.05 | 80.87 | 0.8544 | 39.25 | |
| SecMIQuery=12, Training Setting=Over-training2024.05 | 80.49 | 0.9064 | 9.36 | |
| NaiveHigh-Frequency Filter=Disabled2025.05 | 79.5 | 0.8697 | 6.49 | |
| M.C.Query=3, Training Setting=Over-training2024.05 | 79.35 | 0.8678 | 23.74 | |
| SecMIHigh-Frequency Filter=Disabled2025.05 | 76.37 | 0.8316 | 12.74 | |
| SecMI2026.01 | 76.21 | — | — | |
| Ours2026.01 | 75.33 | — | — | |
| PIAHigh-Frequency Filter=Disabled2025.05 | 72.27 | 0.7676 | 7.75 | |
| PIA2026.01 | 72.14 | — | — | |
| Feature-C2026.01 | 62.55 | — | — | |
| NA-P2026.01 | 57.47 | — | — | |
| Feature-T2026.01 | 54.4 | — | — | |
| Feature-D2026.01 | 53.53 | — | — | |
| GD2026.01 | 51.26 | — | — | |
| Feature-CAttack category=End-to-end attack2026.01 | — | 0.6067 | 7.33 | |
| Feature-DAttack category=End-to-end attack2026.01 | — | 0.551 | 2.8 | |
| Feature-TAttack category=End-to-end attack2026.01 | — | 0.566 | 3 | |
| GDAttack category=End-to-end attack2026.01 | — | 0.5267 | 1.2 | |
| NA-PAttack category=End-to-end attack2026.01 | — | 0.5937 | 4.8 | |
| Noise as a ProbeAttack category=End-to-end attack2026.01 | — | 0.8244 | 14 | |
| PIAAttack category=Intermediate result attack2026.01 | — | 0.7682 | 7.85 | |
| SecMIAttack category=Intermediate result attack2026.01 | — | 0.8326 | 12.88 |