Certified Robustness on MNIST
99.2Certified Accuracy (R=0.00)Meta-1-Dynamic-Margin
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Meta-1-Dynamic-MarginSigma=0.25, Sample Budget=10,0002026.06 | 99.2 | — | — | — | — | — | — | — | — | 1.89 | 200 | |
| KT PriorSigma=0.25, Sample Budget=10,0002026.06 | 99.2 | — | — | — | — | — | — | — | — | 5.08 | 350 | |
| CEAR-(GM)sigma_v=0.252026.05 | 99 | 98 | 96 | 93 | 0 | 0 | 0 | 0 | 0 | — | — | |
| Meta-1-Dynamic-MarginSigma=0.50, Sample Budget=10,0002026.06 | 98.8 | — | — | — | — | — | — | — | — | 2.2 | 433.33 | |
| KT PriorSigma=0.50, Sample Budget=10,0002026.06 | 98.8 | — | — | — | — | — | — | — | — | 4.46 | 283.33 | |
| SWEENsigma_v=0.252026.05 | 98 | 97 | 94 | 90 | 0 | 0 | 0 | 0 | 0 | — | — | |
| CEAR-(RW)sigma_v=0.252026.05 | 98 | 97 | 95 | 93 | 0 | 0 | 0 | 0 | 0 | — | — | |
| CEAR(RW)sigma_v=0.252026.05 | 98 | 97 | 93 | 90 | 0 | 0 | 0 | 0 | 0 | — | — | |
| CEAR(GM)sigma_v=0.252026.05 | 98 | 97 | 93 | 90 | 0 | 0 | 0 | 0 | 0 | — | — | |
| CEAR-(GM)sigma_v=0.502026.05 | 98 | 97 | 94 | 89 | 85 | 72 | 55 | 25 | 0 | — | — | |
| RandSmoothsigma_v=0.252026.05 | 97 | 95 | 93 | 87 | 0 | 0 | 0 | 0 | 0 | — | — | |
| SWEENsigma_v=0.502026.05 | 97 | 97 | 93 | 86 | 84 | 72 | 50 | 20 | 0 | — | — | |
| CEAR-(RW)sigma_v=0.502026.05 | 97 | 94 | 92 | 87 | 75 | 66 | 51 | 26 | 0 | — | — | |
| RandSmoothsigma_v=0.502026.05 | 96 | 95 | 92 | 86 | 77 | 66 | 39 | 18 | 0 | — | — | |
| CEAR(GM)sigma_v=0.502026.05 | 96 | 93 | 90 | 84 | 75 | 61 | 44 | 25 | 0 | — | — | |
| CEAR(RW)sigma_v=0.502026.05 | 94 | 92 | 87 | 83 | 75 | 67 | 58 | 43 | 0 | — | — | |
| Meta-1-Dynamic-MarginSigma=1.00, Sample Budget=10,0002026.06 | 91.2 | — | — | — | — | — | — | — | — | 2.97 | 1,659.09 | |
| KT PriorSigma=1.00, Sample Budget=10,0002026.06 | 91.2 | — | — | — | — | — | — | — | — | 4.01 | 402.27 | |
| CEAR-(GM)sigma_v=1.002026.05 | 91 | 83 | 76 | 69 | 57 | 42 | 31 | 17 | 13 | — | — | |
| CEAR(RW)sigma_v=1.002026.05 | 91 | 87 | 76 | 69 | 60 | 50 | 38 | 34 | 20 | — | — | |
| SWEENsigma_v=1.002026.05 | 88 | 80 | 71 | 64 | 50 | 37 | 28 | 15 | 9 | — | — | |
| CEAR(GM)sigma_v=1.002026.05 | 88 | 80 | 72 | 58 | 45 | 36 | 22 | 12 | 7 | — | — | |
| RandSmoothsigma_v=1.002026.05 | 87 | 80 | 71 | 59 | 42 | 28 | 15 | 9 | 5 | — | — | |
| CEAR-(RW)sigma_v=1.002026.05 | 87 | 79 | 69 | 62 | 58 | 49 | 32 | 22 | 15 | — | — |