# Adversarial Attack on ImageNet (val) with Generative Quality Metrics Source: [Adversarial Attack on ImageNet (val) with Generative Quality Metrics]() Collection index: [llms.txt]() Data updated: 2026-03-04T17:53:26.829Z Evaluation of adversarial attack effectiveness on the ImageNet validation set, reporting Attack Success Rates (ASR) against multiple target classifiers (e.g., ResNet, ViT) alongside image quality and diversity metrics (Inception Score and FID). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Adversarial Attack | | Dataset (including any stated split) | ImageNet (val) | | Metric | Attack Success Rate (ResNet-50) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Attack Success Rate (ResNet-50)](): Higher is better; unit: PERCENT. - [Attack Success Rate (Inception-v3)](): Higher is better; unit: PERCENT. - [Attack Success Rate (ResNet-152)](): Higher is better; unit: PERCENT. - [Attack Success Rate (AdvRes)](): Higher is better; unit: PERCENT. - [Attack Success Rate (AdvInc)](): Higher is better; unit: PERCENT. - [Attack Success Rate (ViT-H)](): Higher is better; unit: PERCENT. - [Attack Success Rate (Max-ViT)](): Higher is better; unit: PERCENT. - [Attack Success Rate (Swin-B)](): Higher is better; unit: PERCENT. - [Attack Success Rate (DeiT)](): Higher is better; unit: PERCENT. - [Average Attack Success Rate](): Higher is better; unit: PERCENT. - [Inception Score (IS)](): Higher is better; unit: SCALAR. - [Fréchet Inception Distance (FID)](): Lower is better; unit: SCALAR. - [Fréchet Inception Distance (FID A)](): Lower is better; unit: SCALAR. ## Recorded results | Method | Attack Success Rate (ResNet-50) | Result date | Report paper | | --- | --- | --- | --- | | AA | 100 | Not recorded | 68fa78e11e209131cea7afbc | | AdvClass | 99.9 | Not recorded | 68fa78e11e209131cea7afbc | | AdvClass | 99.6 | Not recorded | 68fa78e11e209131cea7afbc | | PGD | 99.4 | Not recorded | 68fa78e11e209131cea7afbc | | NatADiff | 99.3 | Not recorded | 68fa78e11e209131cea7afbc | | NatADiff | 96.9 | Not recorded | 68fa78e11e209131cea7afbc | | DiffAttack | 92.5 | Not recorded | 68fa78e11e209131cea7afbc | | ACA | 78.8 | Not recorded | 68fa78e11e209131cea7afbc | | NCF | 74.8 | Not recorded | 68fa78e11e209131cea7afbc | | NatADiff | 70.7 | Not recorded | 68fa78e11e209131cea7afbc | | NatADiff | 67.4 | Not recorded | 68fa78e11e209131cea7afbc | | NatADiff | 66.8 | Not recorded | 68fa78e11e209131cea7afbc | | NatADiff | 53.4 | Not recorded | 68fa78e11e209131cea7afbc | | ACA | 50.9 | Not recorded | 68fa78e11e209131cea7afbc | | ACA | 50.5 | Not recorded | 68fa78e11e209131cea7afbc | | AdvClass | 38 | Not recorded | 68fa78e11e209131cea7afbc | | AdvClass | 35.2 | Not recorded | 68fa78e11e209131cea7afbc | | AdvClass | 35.1 | Not recorded | 68fa78e11e209131cea7afbc | | AdvClass | 33.9 | Not recorded | 68fa78e11e209131cea7afbc | | NCF | 31 | Not recorded | 68fa78e11e209131cea7afbc | | DiffAttack | 29 | Not recorded | 68fa78e11e209131cea7afbc | | DiffAttack | 20.5 | Not recorded | 68fa78e11e209131cea7afbc | | NCF | 20 | Not recorded | 68fa78e11e209131cea7afbc | | AA | 7.3 | Not recorded | 68fa78e11e209131cea7afbc | | AA | 6.5 | Not recorded | 68fa78e11e209131cea7afbc | | PGD | 6 | Not recorded | 68fa78e11e209131cea7afbc | | PGD | 5.8 | Not recorded | 68fa78e11e209131cea7afbc | | Clean | 5.3 | Not recorded | 68fa78e11e209131cea7afbc | ### AA Attack Success Rate (ResNet-50): 100. Result ID: 69a871846dbb7075b9506a39. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50"}. This record does not assert independent reproduction. ### AdvClass Attack Success Rate (ResNet-50): 99.9. Result ID: 69a871846dbb7075b9506a3e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50","Targeting Strategy":"Similarity (U)"}. This record does not assert independent reproduction. ### AdvClass Attack Success Rate (ResNet-50): 99.6. Result ID: 69a871846dbb7075b9506a3d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50","Targeting Strategy":"Random (T)"}. This record does not assert independent reproduction. ### PGD Attack Success Rate (ResNet-50): 99.4. Result ID: 69a871846dbb7075b9506a38. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50"}. This record does not assert independent reproduction. ### NatADiff Attack Success Rate (ResNet-50): 99.3. Result ID: 69a871846dbb7075b9506a40. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50","Targeting Strategy":"Similarity (U)"}. This record does not assert independent reproduction. ### NatADiff Attack Success Rate (ResNet-50): 96.9. Result ID: 69a871846dbb7075b9506a3f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50","Targeting Strategy":"Random (T)"}. This record does not assert independent reproduction. ### DiffAttack Attack Success Rate (ResNet-50): 92.5. Result ID: 69a871846dbb7075b9506a3b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50"}. This record does not assert independent reproduction. ### ACA Attack Success Rate (ResNet-50): 78.8. Result ID: 69a871846dbb7075b9506a3c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"RN-50"}. This record does not assert independent reproduction. ### NCF Attack Success Rate (ResNet-50): 74.8. Result ID: 69a871846dbb7075b9506a3a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Surrogate Model":"RN-50"}. This record does not assert independent reproduction. ### NatADiff Attack Success Rate (ResNet-50): 70.7. Result ID: 69a871846dbb7075b9506a51. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H","Targeting Strategy":"Random (T)"}. This record does not assert independent reproduction. ### NatADiff Attack Success Rate (ResNet-50): 67.4. Result ID: 69a871846dbb7075b9506a49. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3","Targeting Strategy":"Similarity (U)"}. This record does not assert independent reproduction. ### NatADiff Attack Success Rate (ResNet-50): 66.8. Result ID: 69a871846dbb7075b9506a52. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H","Targeting Strategy":"Similarity (U)"}. This record does not assert independent reproduction. ### NatADiff Attack Success Rate (ResNet-50): 53.4. Result ID: 69a871846dbb7075b9506a48. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3","Targeting Strategy":"Random (T)"}. This record does not assert independent reproduction. ### ACA Attack Success Rate (ResNet-50): 50.9. Result ID: 69a871846dbb7075b9506a45. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3"}. This record does not assert independent reproduction. ### ACA Attack Success Rate (ResNet-50): 50.5. Result ID: 69a871846dbb7075b9506a4e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H"}. This record does not assert independent reproduction. ### AdvClass Attack Success Rate (ResNet-50): 38. Result ID: 69a871846dbb7075b9506a47. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3","Targeting Strategy":"Similarity (U)"}. This record does not assert independent reproduction. ### AdvClass Attack Success Rate (ResNet-50): 35.2. Result ID: 69a871846dbb7075b9506a50. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H","Targeting Strategy":"Similarity (U)"}. This record does not assert independent reproduction. ### AdvClass Attack Success Rate (ResNet-50): 35.1. Result ID: 69a871846dbb7075b9506a46. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3","Targeting Strategy":"Random (T)"}. This record does not assert independent reproduction. ### AdvClass Attack Success Rate (ResNet-50): 33.9. Result ID: 69a871846dbb7075b9506a4f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H","Targeting Strategy":"Random (T)"}. This record does not assert independent reproduction. ### NCF Attack Success Rate (ResNet-50): 31. Result ID: 69a871846dbb7075b9506a43. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3"}. This record does not assert independent reproduction. ### DiffAttack Attack Success Rate (ResNet-50): 29. Result ID: 69a871846dbb7075b9506a44. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3"}. This record does not assert independent reproduction. ### DiffAttack Attack Success Rate (ResNet-50): 20.5. Result ID: 69a871846dbb7075b9506a4d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H"}. This record does not assert independent reproduction. ### NCF Attack Success Rate (ResNet-50): 20. Result ID: 69a871846dbb7075b9506a4c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H"}. This record does not assert independent reproduction. ### AA Attack Success Rate (ResNet-50): 7.3. Result ID: 69a871846dbb7075b9506a42. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3"}. This record does not assert independent reproduction. ### AA Attack Success Rate (ResNet-50): 6.5. Result ID: 69a871846dbb7075b9506a4b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H"}. This record does not assert independent reproduction. ### PGD Attack Success Rate (ResNet-50): 6. Result ID: 69a871846dbb7075b9506a41. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"Inc-v3"}. This record does not assert independent reproduction. ### PGD Attack Success Rate (ResNet-50): 5.8. Result ID: 69a871846dbb7075b9506a4a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Surrogate Model":"ViT-H"}. This record does not assert independent reproduction. ### Clean Attack Success Rate (ResNet-50): 5.3. Result ID: 69a871846dbb7075b9506a37. [Reporting paper]() Recorded evaluation configuration: {"Surrogate Model":"N/A","Attack":"None"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.