Privacy Measurement on CIFAR-10
0Tilde EpsilonPANORAMIA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PANORAMIATarget model=ResNet18, epsilon=2, Sample size (m)=10k2024.02 | 0 | 2.44 | 1.709 | — | — | |
| PANORAMIATarget model=ResNet18, epsilon=1, Sample size (m)=10k2024.02 | 0 | 2.44 | 1.412 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=4, Audit setting=RM;GN2024.02 | 0 | 2.44 | 1.99 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=2, Audit setting=RM;GN2024.02 | 0 | 2.44 | 1.709 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=1, Audit setting=RM;GN2024.02 | 0 | 2.44 | 1.412 | — | — | |
| PANORAMIATarget model=Wide-ResNet-16-4, DP Budget (ϵ)=2, Audit Setting=RM;GN2024.02 | 0 | 2.44 | 2.36 | — | — | |
| PANORAMIATarget model=Wide-ResNet-16-4, DP Budget (ϵ)=1, Audit Setting=RM;GN2024.02 | 0 | 2.44 | 1.84 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=6, Audit setting=RM;GN2024.02 | 0.038 | 2.44 | 2.478 | — | — | |
| PANORAMIATarget model=ViT, Epochs=35, Sample size (m)=10k2024.02 | 0.22 | 3.62 | 3.85 | — | — | |
| PANORAMIATarget model=ResNet18, epsilon=10, Sample size (m)=10k2024.02 | 0.26 | 2.44 | 2.7 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=10, Audit setting=RM;GN2024.02 | 0.26 | 2.44 | 2.7 | — | — | |
| O(1) RM;RNTarget model=ResNet18, epsilon=10, Sample size (m)=10k2024.02 | 0.28 | — | — | — | — | |
| PANORAMIATarget model=ResNet101, Epochs=20, Sample size (m)=10k2024.02 | 0.33 | 2.44 | 2.76 | — | — | |
| PANORAMIATarget model=Wide-ResNet-16-4, DP Budget (ϵ)=10, Audit Setting=RM;GN2024.02 | 0.343 | 2.44 | 2.783 | — | — | |
| PANORAMIA RM;RNTarget model=ResNet101, Epochs=20, Sample size (m)=10k2024.02 | 0.421 | 0 | 0.421 | — | — | |
| O(1) RM;RNTarget model=ResNet101, Epochs=20, Sample size (m)=10k2024.02 | 0.45 | — | — | — | — | |
| PANORAMIATarget model=Wide-ResNet-16-4, DP Budget (ϵ)=15, Audit Setting=RM;GN2024.02 | 0.472 | 2.44 | 2.912 | — | — | |
| PANORAMIATarget model=Wide-ResNet-16-4, DP Budget (ϵ)=20, Audit Setting=RM;GN2024.02 | 0.486 | 2.44 | 2.926 | — | — | |
| PANORAMIATarget model=Wide-ResNet-16-4, DP Budget (ϵ)=∞, Audit Setting=RM;GN2024.02 | 0.58 | 2.44 | 3.02 | — | — | |
| PANORAMIA RM;RNTarget model=ResNet101, Epochs=50, Sample size (m)=10k2024.02 | 0.67 | 0 | 0.67 | — | — | |
| PANORAMIATarget model=ResNet101, Epochs=50, Sample size (m)=10k2024.02 | 0.71 | 2.44 | 3.11 | — | — | |
| PANORAMIATarget model=CNN, Epochs=50, Sample size (m)=10k2024.02 | 0.76 | 2.05 | 2.81 | — | — | |
| O(1) RM;RNTarget model=ResNet101, Epochs=50, Sample size (m)=10k2024.02 | 0.79 | — | — | — | — | |
| O(1) RM;RNTarget model=CNN, Epochs=50, Sample size (m)=10k2024.02 | 1.01 | — | — | — | — | |
| PANORAMIATarget model=ResNet18, epsilon=15, Sample size (m)=10k2024.02 | 1.13 | 2.44 | 3.57 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=15, Audit setting=RM;GN2024.02 | 1.13 | 2.44 | 3.57 | — | — | |
| PANORAMIATarget model=ResNet101, Epochs=100, Sample size (m)=10k2024.02 | 1.16 | 2.44 | 3.6 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=20, Audit setting=RM;GN2024.02 | 1.19 | 2.44 | 3.6331 | — | — | |
| O(1) RM;RNTarget model=ResNet18, epsilon=15, Sample size (m)=10k2024.02 | 1.2 | — | — | — | — | |
| PANORAMIA RM;RNTarget model=ResNet101, Epochs=100, Sample size (m)=10k2024.02 | 1.22 | 0 | 1.22 | — | — | |
| PANORAMIATarget model=CNN, Epochs=100, Sample size (m)=10k2024.02 | 1.33 | 2.05 | 3.38 | — | — | |
| O(1) RM;RNTarget model=ResNet101, Epochs=100, Sample size (m)=10k2024.02 | 1.41 | — | — | — | — | |
| PANORAMIATarget model=ResNet18, epsilon=infinity, Sample size (m)=10k2024.02 | 1.43 | 2.44 | 3.87 | — | — | |
| PANORAMIATarget Model=ResNet18, DP Epsilon (target)=infinity, Audit setting=RM;GN2024.02 | 1.43 | 2.44 | 3.87 | — | — | |
| O(1) RM;RNTarget model=CNN, Epochs=100, Sample size (m)=10k2024.02 | 1.46 | — | — | — | — | |
| O(1) RM;RNTarget model=ViT, Epochs=35, Sample size (m)=10k2024.02 | 1.46 | — | — | — | — | |
| O(1) RM;RNTarget model=ResNet18, epsilon=infinity, Sample size (m)=10k2024.02 | 1.471 | — | — | — | — | |
| PANORAMIATarget model=WRN-28-10, Epochs=150, Sample size (m)=10k2024.02 | 2.57 | 2.44 | 5.01 | — | — | |
| O(1) RM;RNTarget model=WRN-28-10, Epochs=150, Sample size (m)=10k2024.02 | 2.96 | — | — | — | — | |
| PANORAMIATarget model=WRN-28-10, Epochs=300, Sample size (m)=10k2024.02 | 3.54 | 2.44 | 5.98 | — | — | |
| O(1) RM;RNTarget model=WRN-28-10, Epochs=300, Sample size (m)=10k2024.02 | 3.73 | — | — | — | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=infinity, Audit setting=RM;RN2024.02 | — | — | — | 1.471 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=20, Audit setting=RM;RN2024.02 | — | — | — | 1.34 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=15, Audit setting=RM;RN2024.02 | — | — | — | 1.22 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=10, Audit setting=RM;RN2024.02 | — | — | — | 0.28 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=6, Audit setting=RM;RN2024.02 | — | — | — | 0.049 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=4, Audit setting=RM;RN2024.02 | — | — | — | 0 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=2, Audit setting=RM;RN2024.02 | — | — | — | 0.05 | — | |
| O(1)Target Model=ResNet18, DP Epsilon (target)=1, Audit setting=RM;RN2024.02 | — | — | — | 0 | — | |
| O(1)Target model=Wide-ResNet-16-4, DP Budget (ϵ)=∞, Audit Setting=RM;RN2024.02 | — | — | — | — | 0.6408 | |
| O(1)Target model=Wide-ResNet-16-4, DP Budget (ϵ)=20, Audit Setting=RM;RN2024.02 | — | — | — | — | 0.5961 | |
| O(1)Target model=Wide-ResNet-16-4, DP Budget (ϵ)=15, Audit Setting=RM;RN2024.02 | — | — | — | — | 0.5774 | |
| O(1)Target model=Wide-ResNet-16-4, DP Budget (ϵ)=10, Audit Setting=RM;RN2024.02 | — | — | — | — | 0.171 | |
| O(1)Target model=Wide-ResNet-16-4, DP Budget (ϵ)=2, Audit Setting=RM;RN2024.02 | — | — | — | — | 0 | |
| O(1)Target model=Wide-ResNet-16-4, DP Budget (ϵ)=1, Audit Setting=RM;RN2024.02 | — | — | — | — | 0 |