# Black-box Adversarial Attack on ImageNet

Source: [Black-box Adversarial Attack on ImageNet](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:07:15.772Z

Evaluation of black-box adversarial attack performance on ImageNet, focusing on robustness metrics under various transformations and defenses (e.g., JPEG compression, specific noise models like R&P, HGD).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Black-box Adversarial Attack |
| Dataset (including any stated split) | ImageNet |
| Metric | Top-1 Accuracy (JPEG) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Top-1 Accuracy (JPEG)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(JPEG)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (Clean)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(Clean)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (Gray)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(Gray)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (R&P)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(R%26P)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (HGD)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(HGD)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (ComDefend)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(ComDefend)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (NRP)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(NRP)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (ResB)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(ResB)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (ReSD)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(ReSD)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (ResNeXtDA)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(ResNeXtDA)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (Inc-v3ens3)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(Inc-v3ens3)>): Higher is better; unit: PERCENT.

- [Top-1 Accuracy (IncRes-v2ens)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-on-imagenet.md?metric=Top-1%20Accuracy%20(IncRes-v2ens)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Top-1 Accuracy (JPEG) | Result date | Report paper |
| --- | --- | --- | --- |
| NCF | 62.6 | Not recorded | 68fa6d931e209131cea3ac5f |
| SAE | 52.7 | Not recorded | 68fa6d931e209131cea3ac5f |
| ColorFool | 42.1 | Not recorded | 68fa6d931e209131cea3ac5f |
| ACE | 31.2 | Not recorded | 68fa6d931e209131cea3ac5f |
| cAdv | 30.6 | Not recorded | 68fa6d931e209131cea3ac5f |
| ReColorAdv | 26.9 | Not recorded | 68fa6d931e209131cea3ac5f |
| Clean baseline | 17.4 | Not recorded | 68fa6d931e209131cea3ac5f |

### NCF

Top-1 Accuracy (JPEG): 62.6. Result ID: 698fabc03a6c314849faf874.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Implementation](<https://github.com/ylhz/Natural-Color-Fool>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

### SAE

Top-1 Accuracy (JPEG): 52.7. Result ID: 698fabc03a6c314849faf86f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64311e209131cea035f7.md>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

### ColorFool

Top-1 Accuracy (JPEG): 42.1. Result ID: 698fabc03a6c314849faf872.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15da8.md>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

### ACE

Top-1 Accuracy (JPEG): 31.2. Result ID: 698fabc03a6c314849faf873.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa682d1e209131cea1a8ba.md>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

### cAdv

Top-1 Accuracy (JPEG): 30.6. Result ID: 698fabc03a6c314849faf871.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67361e209131cea14d9b.md>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

### ReColorAdv

Top-1 Accuracy (JPEG): 26.9. Result ID: 698fabc03a6c314849faf870.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66911e209131cea10f28.md>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

### Clean baseline

Top-1 Accuracy (JPEG): 17.4. Result ID: 698fabc03a6c314849faf86e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d931e209131cea3ac5f.md>)

Recorded evaluation configuration: {"Substitute Model":"Inc-v3"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.