Robustness Verification on MNIST first 100 images (test)
100Certified RateSuper-DeepG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Super-DeepGTransformation=Shearing, Config. number=n°5, Range=[−2, 2], Interval size=4, Clean acc.=100.0%2026.04 | 100 | 0.16 | |
| Super-DeepGTransformation=Shearing, Config. number=n°5, Range=[−2, 2], Interval size=4, Clean acc.=100.0%, P samples=102026.04 | 100 | 0.065 | |
| Super-DeepGTransformation=Scaling, Config. number=n°3, Range=[−2, 2], Interval size=4, Clean acc.=100.0%2026.04 | 99 | 0.16 | |
| Super-DeepGTransformation=Scaling, Config. number=n°3, Range=[−2, 2], Interval size=4, Clean acc.=100.0%, P samples=102026.04 | 99 | 0.063 | |
| DeepGTransformation=Rotation, Config. number=n°1, Range=[−30◦, 30◦], Interval size=1◦, Clean acc.=98.0%2026.04 | 98 | 210.72 | |
| Super-DeepGTransformation=Rotation, Config. number=n°1, Range=[−30◦, 30◦], Interval size=1◦, Clean acc.=98.0%2026.04 | 98 | 0.4 | |
| DeepGTransformation=Scaling, Config. number=n°3, Range=[−2, 2], Interval size=4, Clean acc.=100.0%2026.04 | 98 | 4.25 | |
| DeepGTransformation=Shearing, Config. number=n°5, Range=[−2, 2], Interval size=4, Clean acc.=100.0%2026.04 | 98 | 4.3 | |
| DeepGTransformation=Translation, Config. number=n°7, Range=[−1, 1] × [−1, 1], Interval size=0.2, Clean acc.=99.0%2026.04 | 98 | 460.93 | |
| Super-DeepGTransformation=Translation, Config. number=n°7, Range=[−1, 1] × [−1, 1], Interval size=0.2, Clean acc.=99.0%2026.04 | 98 | 1.34 | |
| DeepGTransformation=Rotation, Config. number=n°1, Range=[−30◦, 30◦], Interval size=6◦, Clean acc.=98.0%2026.04 | 86 | 48.38 | |
| Super-DeepGTransformation=Rotation, Config. number=n°1, Range=[−30◦, 30◦], Interval size=6◦, Clean acc.=98.0%2026.04 | 86 | 1.14 | |
| Super-DeepGTransformation=Rotation, Config. number=n°1, Range=[−30◦, 30◦], Interval size=6◦, Clean acc.=98.0%, P samples=102026.04 | 86 | 0.13 |