Membership Inference Attack on CIFAR-10
98AUCDATM
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DATMModel Arch.=ConvNet, IPC=10002026.03 | 98 | — | — | — | 94 | 77.6 | — | |
| DATMModel Arch.=ResNet18, IPC=5002026.03 | 98 | — | — | — | 94 | 74.9 | — | |
| DATMModel Arch.=VGG11-BN, IPC=5002026.03 | 98 | — | — | — | 93 | 77.1 | — | |
| SelMatchModel Arch.=ResNet18, IPC=10002026.03 | 98 | — | — | — | 94 | 74.8 | — | |
| DATMModel Arch.=ConvNet, IPC=2502026.03 | 97 | — | — | — | 93 | 75.1 | — | |
| DATMModel Arch.=ConvNet, IPC=5002026.03 | 97 | — | — | — | 94 | 75.7 | — | |
| DATMModel Arch.=AlexNet, IPC=10002026.03 | 97 | — | — | — | 93 | 71 | — | |
| DATMModel Arch.=ResNet18, IPC=1002026.03 | 97 | — | — | — | 93 | 76 | — | |
| DATMModel Arch.=ResNet18, IPC=2502026.03 | 97 | — | — | — | 94 | 74.7 | — | |
| DATMModel Arch.=ResNet18, IPC=10002026.03 | 97 | — | — | — | 94 | 72.7 | — | |
| DATMModel Arch.=VGG11-BN, IPC=2502026.03 | 97 | — | — | — | 93 | 76.3 | — | |
| DATMModel Arch.=VGG11-BN, IPC=10002026.03 | 97 | — | — | — | 93 | 73.5 | — | |
| SelMatchModel Arch.=ConvNet, IPC=10002026.03 | 97 | — | — | — | 93 | 73.7 | — | |
| SelMatchModel Arch.=AlexNet, IPC=10002026.03 | 97 | — | — | — | 93 | 77.6 | — | |
| SelMatchModel Arch.=ResNet18, IPC=2502026.03 | 97 | — | — | — | 92 | 68.3 | — | |
| SelMatchModel Arch.=ResNet18, IPC=5002026.03 | 97 | — | — | — | 92 | 69.1 | — | |
| SelMatchModel Arch.=VGG11-BN, IPC=2502026.03 | 97 | — | — | — | 92 | 74.4 | — | |
| SelMatchModel Arch.=VGG11-BN, IPC=5002026.03 | 97 | — | — | — | 92 | 70.6 | — | |
| SelMatchModel Arch.=VGG11-BN, IPC=10002026.03 | 97 | — | — | — | 93 | 74.2 | — | |
| FTDModel Arch.=AlexNet, IPC=10002026.03 | 96 | — | — | — | 90 | 55.8 | — | |
| FTDModel Arch.=ResNet18, IPC=5002026.03 | 96 | — | — | — | 90 | 57.9 | — | |
| FTDModel Arch.=VGG11-BN, IPC=5002026.03 | 96 | — | — | — | 90 | 56.4 | — | |
| DATMModel Arch.=AlexNet, IPC=1002026.03 | 96 | — | — | — | 90 | 51 | — | |
| DATMModel Arch.=AlexNet, IPC=5002026.03 | 96 | — | — | — | 90 | 53.3 | — | |
| SelMatchModel Arch.=ConvNet, IPC=2502026.03 | 96 | — | — | — | 91 | 66.7 | — | |
| SelMatchModel Arch.=ConvNet, IPC=5002026.03 | 96 | — | — | — | 92 | 67.1 | — | |
| SelMatchModel Arch.=AlexNet, IPC=2502026.03 | 96 | — | — | — | 91 | 63.3 | — | |
| SelMatchModel Arch.=AlexNet, IPC=5002026.03 | 96 | — | — | — | 91 | 64.9 | — | |
| MTTModel Arch.=VGG11-BN, IPC=10002026.03 | 95 | — | — | — | 89 | 53.6 | — | |
| FTDModel Arch.=ConvNet, IPC=5002026.03 | 95 | — | — | — | 89 | 51 | — | |
| FTDModel Arch.=ConvNet, IPC=10002026.03 | 95 | — | — | — | 90 | 46.4 | — | |
| FTDModel Arch.=AlexNet, IPC=5002026.03 | 95 | — | — | — | 89 | 53.5 | — | |
| FTDModel Arch.=ResNet18, IPC=10002026.03 | 95 | — | — | — | 89 | 54.1 | — | |
| FTDModel Arch.=VGG11-BN, IPC=10002026.03 | 95 | — | — | — | 89 | 51.4 | — | |
| DATMModel Arch.=ConvNet, IPC=1002026.03 | 95 | — | — | — | 89 | 50.9 | — | |
| DATMModel Arch.=AlexNet, IPC=2502026.03 | 95 | — | — | — | 89 | 49.5 | — | |
| DATMModel Arch.=VGG11-BN, IPC=1002026.03 | 95 | — | — | — | 90 | 53.7 | — | |
| SelMatchModel Arch.=ResNet18, IPC=1002026.03 | 95 | — | — | — | 88 | 45.7 | — | |
| SelMatchModel Arch.=VGG11-BN, IPC=1002026.03 | 95 | — | — | — | 89 | 53.3 | — | |
| SelMatchModel Arch.=ConvNet, IPC=1002026.03 | 94 | — | — | — | 88 | 53.1 | — | |
| SelMatchModel Arch.=AlexNet, IPC=1002026.03 | 93 | — | — | — | 86 | 37.1 | — | |
| SeqMatchModel Arch.=VGG11-BN, IPC=10002026.03 | 93 | — | — | — | 86 | 41.1 | — | |
| ReproMIAQuery=1+1, Target Model=DDPM2026.03 | 92.83 | — | — | — | — | — | 34.14 | |
| SimA-MC#Query=30, #mc=302025.09 | 92.16 | — | — | — | — | 85.21 | 44.74 | |
| SeqMatchModel Arch.=ConvNet, IPC=10002026.03 | 92 | — | — | — | 85 | 29.6 | — | |
| SeqMatchModel Arch.=AlexNet, IPC=10002026.03 | 92 | — | — | — | 85 | 42.7 | — | |
| SeqMatchModel Arch.=ResNet18, IPC=10002026.03 | 92 | — | — | — | 84 | 42.9 | — | |
| SeqMatchModel Arch.=VGG11-BN, IPC=5002026.03 | 92 | — | — | — | 84 | 40.9 | — | |
| PIA#Query=22025.09 | 91.86 | — | — | — | — | 85.06 | 29.54 | |
| SimAFiltering setting=filtered (proposed ranking)2025.11 | 91.26 | — | — | — | — | 83.58 | 24.56 | |
| SimA-MC#Query=10, #mc=102025.09 | 91.23 | — | — | — | — | 84.16 | 43.58 | |
| SeqMatchModel Arch.=ResNet18, IPC=5002026.03 | 91 | — | — | — | 84 | 30.7 | — | |
| SimA-MC#Query=10, #mc=102025.09 | 90.68 | — | — | — | — | 82.71 | 39.86 | |
| SimA (⋆)#Query=12025.09 | 90.45 | — | — | — | — | 83.62 | 35.86 | |
| FTDModel Arch.=VGG11-BN, IPC=2502026.03 | 90 | — | — | — | 82 | 20.1 | — | |
| SeqMatchModel Arch.=AlexNet, IPC=5002026.03 | 90 | — | — | — | 83 | 27.7 | — | |
| SeqMatchModel Arch.=ResNet18, IPC=1002026.03 | 90 | — | — | — | 83 | 32.5 | — | |
| SecMIFiltering setting=filtered (proposed ranking)2025.11 | 89.93 | — | — | — | — | 81.97 | 23.84 | |
| SecMIstat#Query=122025.09 | 89.72 | — | — | — | — | 82.71 | 33.44 | |
| SimAFiltering setting=none2025.11 | 89.1 | — | — | — | — | 81.63 | 19.88 | |
| SimA#Query=12025.09 | 89.1 | — | — | — | — | 81.63 | 19.88 | |
| MTTModel Arch.=ConvNet, IPC=2502026.03 | 89 | — | — | — | 81 | 21.5 | — | |
| MTTModel Arch.=ConvNet, IPC=5002026.03 | 89 | — | — | — | 81 | 20.1 | — | |
| MTTModel Arch.=ResNet18, IPC=10002026.03 | 89 | — | — | — | 82 | 19.9 | — | |
| FTDModel Arch.=ConvNet, IPC=2502026.03 | 89 | — | — | — | 82 | 22 | — | |
| FTDModel Arch.=AlexNet, IPC=1002026.03 | 89 | — | — | — | 82 | 21.6 | — | |
| FTDModel Arch.=ResNet18, IPC=2502026.03 | 89 | — | — | — | 82 | 25 | — | |
| FTDModel Arch.=VGG11-BN, IPC=1002026.03 | 89 | — | — | — | 81 | 16 | — | |
| SeqMatchModel Arch.=ConvNet, IPC=2502026.03 | 89 | — | — | — | 81 | 25.6 | — | |
| SeqMatchModel Arch.=ConvNet, IPC=5002026.03 | 89 | — | — | — | 82 | 18 | — | |
| SeqMatchModel Arch.=VGG11-BN, IPC=1002026.03 | 89 | — | — | — | 81 | 20.5 | — | |
| SeqMatchModel Arch.=VGG11-BN, IPC=2502026.03 | 89 | — | — | — | 82 | 26.4 | — | |
| PIAFiltering setting=filtered (proposed ranking)2025.11 | 88.49 | — | — | — | — | 80.65 | 20.08 | |
| PIANQuery=1+1, Target Model=DDPM2026.03 | 88.34 | — | — | — | — | — | 31.09 | |
| MTTModel Arch.=ConvNet, IPC=10002026.03 | 88 | — | — | — | 82 | 19.5 | — | |
| MTTModel Arch.=AlexNet, IPC=5002026.03 | 88 | — | — | — | 80 | 20.2 | — | |
| MTTModel Arch.=AlexNet, IPC=10002026.03 | 88 | — | — | — | 80 | 20.2 | — | |
| MTTModel Arch.=ResNet18, IPC=2502026.03 | 88 | — | — | — | 80 | 17.2 | — | |
| MTTModel Arch.=VGG11-BN, IPC=5002026.03 | 88 | — | — | — | 81 | 16.7 | — | |
| FTDModel Arch.=ConvNet, IPC=1002026.03 | 88 | — | — | — | 80 | 20.7 | — | |
| FTDModel Arch.=ResNet18, IPC=1002026.03 | 88 | — | — | — | 80 | 16.2 | — | |
| SeqMatchModel Arch.=ResNet18, IPC=2502026.03 | 88 | — | — | — | 83 | 22 | — | |
| SecMIQuery=10+2, Target Model=DDPM2026.03 | 87.77 | — | — | — | — | — | 15.59 | |
| SecMIFiltering setting=none2025.11 | 87.42 | — | — | — | — | 80.12 | 19.11 | |
| SecMIstat#Query=122025.09 | 87.42 | — | — | — | — | 80.12 | 19.11 | |
| PIAQuery=1+1, Target Model=DDPM2026.03 | 87.11 | — | — | — | — | — | 20.19 | |
| MTTModel Arch.=ResNet18, IPC=5002026.03 | 87 | — | — | — | 80 | 18.2 | — | |
| MTTModel Arch.=VGG11-BN, IPC=2502026.03 | 87 | — | — | — | 79 | 14.3 | — | |
| SeqMatchModel Arch.=ConvNet, IPC=1002026.03 | 87 | — | — | — | 79 | 17.1 | — | |
| SimAFiltering setting=random drop (40%)2025.11 | 86.44 | — | — | — | — | 78.8 | 15.92 | |
| FTDModel Arch.=AlexNet, IPC=2502026.03 | 86 | — | — | — | 78 | 13.8 | — | |
| SeqMatchModel Arch.=AlexNet, IPC=2502026.03 | 86 | — | — | — | 79 | 24.5 | — | |
| PIAFiltering setting=none2025.11 | 85.73 | — | — | — | — | 78.19 | 15.9 | |
| PIA#Query=22025.09 | 85.73 | — | — | — | — | 78.19 | 15.9 | |
| MTTModel Arch.=ConvNet, IPC=1002026.03 | 85 | — | — | — | 77 | 12.5 | — | |
| MTTModel Arch.=VGG11-BN, IPC=1002026.03 | 85 | — | — | — | 77 | 11.2 | — | |
| SeqMatchModel Arch.=AlexNet, IPC=1002026.03 | 85 | — | — | — | 77 | 20.8 | — | |
| Tmc_cal#mc=52026.03 | 84.89 | — | — | — | — | — | 27.88 | |
| Loss#Query=12025.09 | 84.73 | — | — | — | — | 77.67 | 24.14 | |
| ReproMIABackbone=WRN28-102026.03 | 81.31 | — | — | 73.23 | — | — | — |