Certified Image Classification on MNIST (test)
99.45Certified Accuracy (r=0.00)SmoothMix
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SmoothMixsigma (σ)=0.25, eta (η)=5.0, One-Step adversary=false2021.11 | 99.45 | 98.17 | 0 | 0 | 0 | 0 | |
| Consistencysigma (σ)=0.252021.11 | 99.43 | 97.92 | 0 | 0 | 0 | 0 | |
| SmoothMixsigma (σ)=0.25, eta (η)=1.0, One-Step adversary=false2021.11 | 99.43 | 98.1 | 0 | 0 | 0 | 0 | |
| SmoothAdvsigma (σ)=0.252021.11 | 99.39 | 98.17 | 0 | 0 | 0 | 0 | |
| SmoothMix + One-Step adversarysigma (σ)=0.25, eta (η)=1.0, One-Step adversary=true2021.11 | 99.39 | 98.17 | 0 | 0 | 0 | 0 | |
| SmoothMix + One-Step adversarysigma (σ)=0.25, eta (η)=5.0, One-Step adversary=true2021.11 | 99.37 | 98.2 | 0 | 0 | 0 | 0 | |
| Stability trainingsigma (σ)=0.252021.11 | 99.34 | 97.12 | 0 | 0 | 0 | 0 | |
| MACERsigma (σ)=0.252021.11 | 99.33 | 97.35 | 0 | 0 | 0 | 0 | |
| Stability trainingsigma (σ)=0.502021.11 | 99.26 | 97.27 | 90.75 | 69.15 | 0 | 0 | |
| Gaussiansigma (σ)=0.252021.11 | 99.25 | 96.75 | 0 | 0 | 0 | 0 | |
| Gaussiansigma (σ)=0.502021.11 | 99.15 | 96.9 | 89.83 | 67.8 | 0 | 0 | |
| Consistencysigma (σ)=0.502021.11 | 99.15 | 97.51 | 92.89 | 78.26 | 0 | 0 | |
| SmoothMixsigma (σ)=0.50, eta (η)=1.0, One-Step adversary=false2021.11 | 99.1 | 97.51 | 92.91 | 80.15 | 0 | 0 | |
| SmoothAdvsigma (σ)=0.502021.11 | 99.03 | 97.36 | 92.94 | 81.06 | 0 | 0 | |
| SmoothMix + One-Step adversarysigma (σ)=0.50, eta (η)=1.0, One-Step adversary=true2021.11 | 98.74 | 97.09 | 92.67 | 81.7 | 0 | 0 | |
| MACERsigma (σ)=0.502021.11 | 98.69 | 96.28 | 90.14 | 72.12 | 0 | 0 | |
| SmoothMixsigma (σ)=0.50, eta (η)=5.0, One-Step adversary=false2021.11 | 98.64 | 96.98 | 92.63 | 81.85 | 0 | 0 | |
| SmoothMix + One-Step adversarysigma (σ)=0.50, eta (η)=5.0, One-Step adversary=true2021.11 | 98.21 | 96.34 | 91.46 | 81.2 | 0 | 0 | |
| Stability trainingsigma (σ)=1.002021.11 | 96.43 | 91.63 | 80.45 | 60.53 | 33.35 | 11.05 | |
| Gaussiansigma (σ)=1.002021.11 | 96.34 | 91.39 | 79.86 | 59.49 | 32.46 | 10.93 | |
| SmoothAdvsigma (σ)=1.002021.11 | 95.76 | 90.72 | 80.81 | 64.44 | 43.25 | 22.58 | |
| SmoothMixsigma (σ)=1.00, eta (η)=1.0, One-Step adversary=false2021.11 | 95.52 | 90.5 | 80.55 | 64.09 | 43.16 | 23.94 | |
| Consistencysigma (σ)=1.002021.11 | 94.96 | 89.75 | 79.7 | 63.54 | 41.74 | 20.22 | |
| SmoothMix + One-Step adversarysigma (σ)=1.00, eta (η)=1.0, One-Step adversary=true2021.11 | 94.72 | 89.4 | 79.46 | 64.04 | 44.82 | 27.35 | |
| SmoothMixsigma (σ)=1.00, eta (η)=5.0, One-Step adversary=false2021.11 | 93.71 | 88 | 77.95 | 62.78 | 44.87 | 28.88 | |
| SmoothMix + One-Step adversarysigma (σ)=1.00, eta (η)=5.0, One-Step adversary=true2021.11 | 93.11 | 87.24 | 77.22 | 62.48 | 44.85 | 29.66 | |
| MACERsigma (σ)=1.002021.11 | 91.59 | 83.44 | 71.1 | 55.67 | 38.67 | 20.09 |