# Image Classification on SVHN 1.0 (test) (Adversarial Robustness) Source: [Image Classification on SVHN 1.0 (test) (Adversarial Robustness)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:53:33.192Z Evaluation of Image Classification performance on the test split of SVHN version 1.0, specifically reporting accuracy under various adversarial attacks (FGSM, PGD, CW, AA) alongside natural accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | SVHN 1.0 (test) | | Metric | Natural Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Natural Accuracy](): Higher is better; unit: PERCENT. - [FGSM Accuracy](): Higher is better; unit: PERCENT. - [PGD Accuracy](): Higher is better; unit: PERCENT. - [CW-inf Accuracy](): Higher is better; unit: PERCENT. - [AP Score](): Higher is better; unit: PERCENT. - [DLR Score](): Higher is better; unit: PERCENT. - [AA Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Natural Accuracy | Result date | Report paper | | --- | --- | --- | --- | | MART | 94.2 | Not recorded | 68fa6eb41e209131cea419ed | | AWP + CAFE | 94.2 | Not recorded | 68fa6eb41e209131cea419ed | | ADV | 94 | Not recorded | 68fa6eb41e209131cea419ed | | HELP + CAFE | 94 | Not recorded | 68fa6eb41e209131cea419ed | | TRADES | 93.8 | Not recorded | 68fa6eb41e209131cea419ed | | MART | 93.7 | Not recorded | 68fa6eb41e209131cea419ed | | ADV + CAFE | 93.7 | Not recorded | 68fa6eb41e209131cea419ed | | HELP | 93.5 | Not recorded | 68fa6eb41e209131cea419ed | | AWP + CAFE | 93.4 | Not recorded | 68fa6eb41e209131cea419ed | | TRADES | 93.2 | Not recorded | 68fa6eb41e209131cea419ed | | AWP | 93.2 | Not recorded | 68fa6eb41e209131cea419ed | | MART + CAFE | 93 | Not recorded | 68fa6eb41e209131cea419ed | | HELP + CAFE | 92.9 | Not recorded | 68fa6eb41e209131cea419ed | | ADV | 92.8 | Not recorded | 68fa6eb41e209131cea419ed | | MART | 92.6 | Not recorded | 68fa6eb41e209131cea419ed | | HELP | 92.6 | Not recorded | 68fa6eb41e209131cea419ed | | ADV + CAFE | 92.5 | Not recorded | 68fa6eb41e209131cea419ed | | TRADES + CAFE | 92.4 | Not recorded | 68fa6eb41e209131cea419ed | | MART + CAFE | 92.2 | Not recorded | 68fa6eb41e209131cea419ed | | AWP | 92.2 | Not recorded | 68fa6eb41e209131cea419ed | | ADV | 91.9 | Not recorded | 68fa6eb41e209131cea419ed | | TRADES | 91.9 | Not recorded | 68fa6eb41e209131cea419ed | | AWP + CAFE | 91.9 | Not recorded | 68fa6eb41e209131cea419ed | | ADV + CAFE | 91.5 | Not recorded | 68fa6eb41e209131cea419ed | | HELP + CAFE | 91.5 | Not recorded | 68fa6eb41e209131cea419ed | | MART + CAFE | 91.3 | Not recorded | 68fa6eb41e209131cea419ed | | TRADES + CAFE | 91.3 | Not recorded | 68fa6eb41e209131cea419ed | | HELP | 91.2 | Not recorded | 68fa6eb41e209131cea419ed | | AWP | 90.8 | Not recorded | 68fa6eb41e209131cea419ed | | TRADES + CAFE | 90.3 | Not recorded | 68fa6eb41e209131cea419ed | ### MART Natural Accuracy: 94.2. Result ID: 699053c63a6c314849ffc0e8. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### AWP + CAFE Natural Accuracy: 94.2. Result ID: 699053c63a6c314849ffc0eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### ADV Natural Accuracy: 94. Result ID: 699053c63a6c314849ffc0e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### HELP + CAFE Natural Accuracy: 94. Result ID: 699053c63a6c314849ffc0ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### TRADES Natural Accuracy: 93.8. Result ID: 699053c63a6c314849ffc0e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### MART Natural Accuracy: 93.7. Result ID: 699053c63a6c314849ffc0de. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### ADV + CAFE Natural Accuracy: 93.7. Result ID: 699053c63a6c314849ffc0e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### HELP Natural Accuracy: 93.5. Result ID: 699053c63a6c314849ffc0ec. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### AWP + CAFE Natural Accuracy: 93.4. Result ID: 699053c63a6c314849ffc0e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### TRADES Natural Accuracy: 93.2. Result ID: 699053c63a6c314849ffc0dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### AWP Natural Accuracy: 93.2. Result ID: 699053c63a6c314849ffc0ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### MART + CAFE Natural Accuracy: 93. Result ID: 699053c63a6c314849ffc0e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### HELP + CAFE Natural Accuracy: 92.9. Result ID: 699053c63a6c314849ffc0e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### ADV Natural Accuracy: 92.8. Result ID: 699053c63a6c314849ffc0da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### MART Natural Accuracy: 92.6. Result ID: 699053c63a6c314849ffc0d4. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### HELP Natural Accuracy: 92.6. Result ID: 699053c63a6c314849ffc0e2. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### ADV + CAFE Natural Accuracy: 92.5. Result ID: 699053c63a6c314849ffc0db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### TRADES + CAFE Natural Accuracy: 92.4. Result ID: 699053c63a6c314849ffc0e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"WideResNet-34-10"}. This record does not assert independent reproduction. ### MART + CAFE Natural Accuracy: 92.2. Result ID: 699053c63a6c314849ffc0df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### AWP Natural Accuracy: 92.2. Result ID: 699053c63a6c314849ffc0e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### ADV Natural Accuracy: 91.9. Result ID: 699053c63a6c314849ffc0d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### TRADES Natural Accuracy: 91.9. Result ID: 699053c63a6c314849ffc0d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### AWP + CAFE Natural Accuracy: 91.9. Result ID: 699053c63a6c314849ffc0d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### ADV + CAFE Natural Accuracy: 91.5. Result ID: 699053c63a6c314849ffc0d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### HELP + CAFE Natural Accuracy: 91.5. Result ID: 699053c63a6c314849ffc0d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### MART + CAFE Natural Accuracy: 91.3. Result ID: 699053c63a6c314849ffc0d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### TRADES + CAFE Natural Accuracy: 91.3. Result ID: 699053c63a6c314849ffc0dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet-18"}. This record does not assert independent reproduction. ### HELP Natural Accuracy: 91.2. Result ID: 699053c63a6c314849ffc0d8. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### AWP Natural Accuracy: 90.8. Result ID: 699053c63a6c314849ffc0d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. ### TRADES + CAFE Natural Accuracy: 90.3. Result ID: 699053c63a6c314849ffc0d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"VGG-16"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.