One-run DP privacy auditing on CIFAR10 (test)
99Mean ScoreIBIS no reg.
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| IBIS no reg.Theoretical epsilon=10, Crafting architecture=WRN16-42026.05 | 99 | 0.62 | 90 | |
| IBIS no reg.Theoretical epsilon=10, Crafting architecture=ResNet92026.05 | 90 | 0.26 | 85 | |
| Boglioni et al.Theoretical epsilon=10, Crafting architecture=ResNet92026.05 | 74 | 0.48 | 64 | |
| IBIS reg.Theoretical epsilon=10, Crafting architecture=ResNet92026.05 | 60 | 0.22 | 58 | |
| IBIS no reg.Theoretical epsilon=4, Crafting architecture=ResNet92026.05 | 41 | 0.43 | 28 | |
| Boglioni et al.Theoretical epsilon=4, Crafting architecture=ResNet92026.05 | 41 | 0.46 | 22 | |
| IBIS reg.Theoretical epsilon=4, Crafting architecture=ResNet92026.05 | 40 | 0.18 | 47 | |
| IBIS reg.Theoretical epsilon=10, Crafting architecture=WRN16-42026.05 | 38 | 0.24 | 34 | |
| IBIS reg.Theoretical epsilon=2, Crafting architecture=ResNet92026.05 | 36 | 0.2 | 37 | |
| IBIS reg.Theoretical epsilon=4, Crafting architecture=WRN16-42026.05 | 32 | 0.16 | 34 | |
| IBIS no reg.Theoretical epsilon=4, Crafting architecture=WRN16-42026.05 | 28 | 0.2 | 34 | |
| Random + FlipTheoretical epsilon=2, Crafting architecture=ResNet92026.05 | 28 | 0.25 | 22 | |
| Random + FlipTheoretical epsilon=4, Crafting architecture=ResNet92026.05 | 27 | 0.29 | 17 | |
| Boglioni et al.Theoretical epsilon=2, Crafting architecture=ResNet92026.05 | 26 | 0.14 | 25 | |
| Boglioni et al.Theoretical epsilon=1, Crafting architecture=ResNet92026.05 | 24 | 0.16 | 25 | |
| RandomTheoretical epsilon=4, Crafting architecture=ResNet92026.05 | 22 | 0.34 | 9 | |
| Random + FlipTheoretical epsilon=10, Crafting architecture=ResNet92026.05 | 20 | 0.17 | 19 | |
| IBIS reg.Theoretical epsilon=1, Crafting architecture=ResNet92026.05 | 19 | 0.21 | 16 | |
| IBIS no reg.Theoretical epsilon=2, Crafting architecture=WRN16-42026.05 | 18 | 0.22 | 18 | |
| Random + FlipTheoretical epsilon=1, Crafting architecture=ResNet92026.05 | 18 | 0.35 | 1 | |
| IBIS reg.Theoretical epsilon=1, Crafting architecture=WRN16-42026.05 | 18 | 0.17 | 18 | |
| IBIS reg.Theoretical epsilon=2, Crafting architecture=WRN16-42026.05 | 14 | 0.14 | 14 | |
| RandomTheoretical epsilon=10, Crafting architecture=ResNet92026.05 | 12 | 0.09 | 11 | |
| IBIS no reg.Theoretical epsilon=2, Crafting architecture=ResNet92026.05 | 12 | 0.09 | 17 | |
| IBIS no reg.Theoretical epsilon=1, Crafting architecture=ResNet92026.05 | 11 | 0.11 | 7 | |
| RandomTheoretical epsilon=1, Crafting architecture=ResNet92026.05 | 8 | 0.12 | 1 | |
| RandomTheoretical epsilon=2, Crafting architecture=ResNet92026.05 | 3 | 0.04 | 1 | |
| IBIS no reg.Theoretical epsilon=1, Crafting architecture=WRN16-42026.05 | 0 | 0.08 | 0 |