Image Classification on SVHN (test) (Accuracy, ECE, NLL, and BS)
92.67Accuracy (ACC)DP-NGD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DP-NGDBackbone=WRN-16-4, Privacy Budget (epsilon)=8.02026.07 | 92.67 | — | — | — | |
| DP-NGDBackbone=WRN-16-4, Privacy Budget (epsilon)=6.02026.07 | 92.28 | — | — | — | |
| DP-NGDBackbone=WRN-16-4, Privacy Budget (epsilon)=4.02026.07 | 90.7 | — | — | — | |
| AdaDPSBackbone=WRN-16-4, Privacy Budget (epsilon)=8.02026.07 | 89.98 | — | — | — | |
| AdaDPSBackbone=WRN-16-4, Privacy Budget (epsilon)=6.02026.07 | 89.35 | — | — | — | |
| GEPBackbone=WRN-16-4, Privacy Budget (epsilon)=8.02026.07 | 89.29 | — | — | — | |
| DP-SGD-PTBackbone=WRN-16-4, Privacy Budget (epsilon)=8.02026.07 | 89.18 | — | — | — | |
| GEPBackbone=WRN-16-4, Privacy Budget (epsilon)=6.02026.07 | 88.84 | — | — | — | |
| DP-SGDBackbone=WRN-16-4, Privacy Budget (epsilon)=8.02026.07 | 88.6 | — | — | — | |
| DP-SGD-PTBackbone=WRN-16-4, Privacy Budget (epsilon)=6.02026.07 | 88.59 | — | — | — | |
| DP-NGDBackbone=WRN-16-4, Privacy Budget (epsilon)=2.02026.07 | 88.42 | — | — | — | |
| GEPBackbone=WRN-16-4, Privacy Budget (epsilon)=4.02026.07 | 88.27 | — | — | — | |
| AdaDPSBackbone=WRN-16-4, Privacy Budget (epsilon)=4.02026.07 | 88.23 | — | — | — | |
| DP-SGDBackbone=WRN-16-4, Privacy Budget (epsilon)=6.02026.07 | 87.49 | — | — | — | |
| DP-SGD-PTBackbone=WRN-16-4, Privacy Budget (epsilon)=4.02026.07 | 87.37 | — | — | — | |
| DP-SGDBackbone=WRN-16-4, Privacy Budget (epsilon)=4.02026.07 | 87.01 | — | — | — | |
| GEPBackbone=WRN-16-4, Privacy Budget (epsilon)=2.02026.07 | 86.21 | — | — | — | |
| AdaDPSBackbone=WRN-16-4, Privacy Budget (epsilon)=2.02026.07 | 86.12 | — | — | — | |
| FedIvonprediction_type=Monte Carlo averaging, samples=5002024.11 | 84.76 | 1.48 | 0.5303 | 22.1 | |
| DP-NGDBackbone=WRN-16-4, Privacy Budget (epsilon)=1.02026.07 | 84.65 | — | — | — | |
| FedIvon@meanprediction_type=point estimate based predictions evaluated at the mean of IVON posterior2024.11 | 84.54 | 2.41 | 0.5624 | 22.56 | |
| DP-SGD-PTBackbone=WRN-16-4, Privacy Budget (epsilon)=2.02026.07 | 84.11 | — | — | — | |
| DP-SGDBackbone=WRN-16-4, Privacy Budget (epsilon)=2.02026.07 | 83.96 | — | — | — | |
| FedAvg2024.11 | 82.14 | 3.11 | 0.6857 | 26.4 | |
| FedLaplace2024.11 | 81.99 | 2.11 | 0.6423 | 26.27 | |
| AdaDPSBackbone=WRN-16-4, Privacy Budget (epsilon)=1.02026.07 | 79.87 | — | — | — | |
| GEPBackbone=WRN-16-4, Privacy Budget (epsilon)=1.02026.07 | 79.73 | — | — | — | |
| DP-SGD-PTBackbone=WRN-16-4, Privacy Budget (epsilon)=1.02026.07 | 79.54 | — | — | — | |
| DP-SGDBackbone=WRN-16-4, Privacy Budget (epsilon)=1.02026.07 | 79.34 | — | — | — |