Linear Classification on CIFAR-10 (test)
94.7Top-1 AccuracyBYOL w/ DSSL
Evaluation results
| Method | Links | |
|---|---|---|
| BYOL w/ DSSLBase Algorithm=BYOL, Backbone=ResNet-18, Method=DSSL, Augmentation=Standard + Heavy (T~)2021.10 | 94.7 | |
| SimSiam w/ DSSLBase Algorithm=SimSiam, Backbone=ResNet-18, Method=DSSL, Augmentation=Standard + Heavy (T~)2021.10 | 94.5 | |
| BYOL w/ T~Base Algorithm=BYOL, Backbone=ResNet-18, Augmentation=Standard + Heavy (T~)2021.10 | 94.4 | |
| SimCLR w/ DSSLBase Algorithm=SimCLR, Backbone=ResNet-18, Method=DSSL, Augmentation=Standard + Heavy (T~)2021.10 | 93.2 | |
| BYOL (repro.)Base Algorithm=BYOL, Backbone=ResNet-18, Augmentation=Standard, Reproduction=true2021.10 | 92.2 | |
| SimCLR w/ T~Base Algorithm=SimCLR, Backbone=ResNet-18, Augmentation=Standard + Heavy (T~)2021.10 | 92.2 | |
| SimSiam (repro.)Base Algorithm=SimSiam, Backbone=ResNet-18, Augmentation=Standard, Reproduction=true2021.10 | 92.1 | |
| SimCLR (repro.)Base Algorithm=SimCLR, Backbone=ResNet-18, Augmentation=Standard, Reproduction=true2021.10 | 91.5 | |
| No randomizationPrivacy Budget (ε)=0.5, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=1.0, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=1.5, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=2.0, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=2.5, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=3.0, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=3.5, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=4.0, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=4.5, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=5.0, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=7.5, m (dimension size)=642026.05 | 90.58 | |
| No randomizationPrivacy Budget (ε)=10.0, m (dimension size)=642026.05 | 90.58 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=10.0, m (dimension size)=642026.05 | 75.19 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=10.0, m (dimension size)=642026.05 | 74.85 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=7.5, m (dimension size)=642026.05 | 67.82 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=7.5, m (dimension size)=642026.05 | 66.75 | |
| PrivUnit2Privacy Budget (ε)=10.0, m (dimension size)=642026.05 | 57.28 | |
| PrivUnitGPrivacy Budget (ε)=10.0, m (dimension size)=642026.05 | 53.92 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=5.0, m (dimension size)=642026.05 | 53.68 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=5.0, m (dimension size)=642026.05 | 53.02 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=4.5, m (dimension size)=642026.05 | 49.62 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=4.5, m (dimension size)=642026.05 | 49.12 | |
| PrivUnit2Privacy Budget (ε)=7.5, m (dimension size)=642026.05 | 46.81 | |
| PrivUnitGPrivacy Budget (ε)=7.5, m (dimension size)=642026.05 | 45.51 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=4.0, m (dimension size)=642026.05 | 45.1 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=4.0, m (dimension size)=642026.05 | 44.72 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=3.5, m (dimension size)=642026.05 | 40.14 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=3.5, m (dimension size)=642026.05 | 39.97 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=3.0, m (dimension size)=642026.05 | 34.96 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=3.0, m (dimension size)=642026.05 | 34.92 | |
| PrivUnit2Privacy Budget (ε)=5.0, m (dimension size)=642026.05 | 33.97 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=10.0, m (dimension size)=642026.05 | 33.42 | |
| PrivUnitGPrivacy Budget (ε)=5.0, m (dimension size)=642026.05 | 33.3 | |
| PrivUnit2Privacy Budget (ε)=4.5, m (dimension size)=642026.05 | 31.09 | |
| PrivUnitGPrivacy Budget (ε)=4.5, m (dimension size)=642026.05 | 30.67 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=2.5, m (dimension size)=642026.05 | 29.71 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=2.5, m (dimension size)=642026.05 | 29.67 | |
| PrivUnit2Privacy Budget (ε)=4.0, m (dimension size)=642026.05 | 28.27 | |
| PrivUnitGPrivacy Budget (ε)=4.0, m (dimension size)=642026.05 | 28.08 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=7.5, m (dimension size)=642026.05 | 26.58 | |
| PrivUnit2Privacy Budget (ε)=3.5, m (dimension size)=642026.05 | 25.61 | |
| PrivUnitGPrivacy Budget (ε)=3.5, m (dimension size)=642026.05 | 25.46 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=2.0, m (dimension size)=642026.05 | 24.64 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=2.0, m (dimension size)=642026.05 | 24.61 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=10.0, m (dimension size)=642026.05 | 24.26 | |
| PrivUnit2Privacy Budget (ε)=3.0, m (dimension size)=642026.05 | 22.99 | |
| PrivUnitGPrivacy Budget (ε)=3.0, m (dimension size)=642026.05 | 22.79 | |
| PrivUnit2Privacy Budget (ε)=2.5, m (dimension size)=642026.05 | 20.47 | |
| PrivUnitGPrivacy Budget (ε)=2.5, m (dimension size)=642026.05 | 20.32 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=5.0, m (dimension size)=642026.05 | 20.06 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=7.5, m (dimension size)=642026.05 | 20.01 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=1.5, m (dimension size)=642026.05 | 19.97 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=1.5, m (dimension size)=642026.05 | 19.89 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=4.5, m (dimension size)=642026.05 | 18.91 | |
| PrivUnit2Privacy Budget (ε)=2.0, m (dimension size)=642026.05 | 18.05 | |
| PrivUnitGPrivacy Budget (ε)=2.0, m (dimension size)=642026.05 | 17.95 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=4.0, m (dimension size)=642026.05 | 17.77 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=3.5, m (dimension size)=642026.05 | 16.61 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=5.0, m (dimension size)=642026.05 | 16.15 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=1.0, m (dimension size)=642026.05 | 15.98 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=1.0, m (dimension size)=642026.05 | 15.87 | |
| PrivUnit2Privacy Budget (ε)=1.5, m (dimension size)=642026.05 | 15.72 | |
| PrivUnitGPrivacy Budget (ε)=1.5, m (dimension size)=642026.05 | 15.64 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=3.0, m (dimension size)=642026.05 | 15.55 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=4.5, m (dimension size)=642026.05 | 15.46 | |
| Laplace (ℓ1)Privacy Budget (ε)=10.0, m (dimension size)=642026.05 | 14.8 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=4.0, m (dimension size)=642026.05 | 14.8 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=2.5, m (dimension size)=642026.05 | 14.54 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=3.5, m (dimension size)=642026.05 | 14.14 | |
| PrivUnit2Privacy Budget (ε)=1.0, m (dimension size)=642026.05 | 13.63 | |
| PrivUnitGPrivacy Budget (ε)=1.0, m (dimension size)=642026.05 | 13.53 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=2.0, m (dimension size)=642026.05 | 13.52 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=3.0, m (dimension size)=642026.05 | 13.49 | |
| Laplace (ℓ1)Privacy Budget (ε)=7.5, m (dimension size)=642026.05 | 13.47 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=2.5, m (dimension size)=642026.05 | 12.86 | |
| Task-AwarePrivacy Budget (ε)=10.0, m (dimension size)=642026.05 | 12.76 | |
| PrivUnitG + Proposed Approach (PA)Privacy Budget (ε)=0.5, m (dimension size)=642026.05 | 12.65 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=1.5, m (dimension size)=642026.05 | 12.58 | |
| PrivUnit2 + Proposed Approach (PA)Privacy Budget (ε)=0.5, m (dimension size)=642026.05 | 12.58 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=2.0, m (dimension size)=642026.05 | 12.27 | |
| Laplace (ℓ1)Privacy Budget (ε)=5.0, m (dimension size)=642026.05 | 12.21 | |
| Laplace (ℓ1)Privacy Budget (ε)=4.5, m (dimension size)=642026.05 | 11.99 | |
| Laplace (ℓ1)Privacy Budget (ε)=4.0, m (dimension size)=642026.05 | 11.76 | |
| PrivUnit2Privacy Budget (ε)=0.5, m (dimension size)=642026.05 | 11.74 | |
| Laplace + Proposed Approach (PA)Privacy Budget (ε)=1.0, m (dimension size)=642026.05 | 11.7 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=1.5, m (dimension size)=642026.05 | 11.7 | |
| PrivUnitGPrivacy Budget (ε)=0.5, m (dimension size)=642026.05 | 11.61 | |
| Laplace (ℓ1)Privacy Budget (ε)=3.5, m (dimension size)=642026.05 | 11.51 | |
| Task-AwarePrivacy Budget (ε)=7.5, m (dimension size)=642026.05 | 11.45 | |
| Laplace (ℓ1)Privacy Budget (ε)=3.0, m (dimension size)=642026.05 | 11.26 | |
| CW + Proposed Approach (PA) w/o boundingPrivacy Budget (ε)=1.0, m (dimension size)=642026.05 | 11.14 | |
| Laplace (ℓ1)Privacy Budget (ε)=2.5, m (dimension size)=642026.05 | 11.03 |