Membership Inference on CINIC-10 (Delta Metrics)
0.081Delta AUCRMIA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RMIABackbone=ResNet-18, Shadow Models (K)=254, Replicates=322026.03 | 0.081 | 0.122 | |
| RMIABackbone=WideResNet, Shadow Models (K)=254, Replicates=322026.03 | 0.054 | 0.061 | |
| BASE3Backbone=ResNet-18, Shadow Models (K)=254, Replicates=322026.03 | 0.008 | 0.013 | |
| BASE3Backbone=WideResNet, Shadow Models (K)=254, Replicates=322026.03 | 0.003 | 0.004 | |
| BaVarIA-nBackbone=ResNet-18, Shadow Models (K)=254, Replicates=322026.03 | 0 | 0 | |
| BaVarIA-tBackbone=ResNet-18, Shadow Models (K)=254, Replicates=322026.03 | 0 | 0 | |
| BaVarIA-nBackbone=WideResNet, Shadow Models (K)=254, Replicates=322026.03 | 0 | 0.001 | |
| BaVarIA-tBackbone=WideResNet, Shadow Models (K)=254, Replicates=322026.03 | 0 | 0.001 |