# Black-box Adversarial Attack (Image Retrieval) on Stanford Online Products (test)

Source: [Black-box Adversarial Attack (Image Retrieval) on Stanford Online Products (test)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:01:21.669Z

Evaluation of the effectiveness of black-box adversarial attacks against an image retrieval model trained on the Stanford Online Products test set, measured using Recall@K, Attack Quality (AQ), and Attack Success Rate (ASR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Black-box Adversarial Attack (Image Retrieval) |
| Dataset (including any stated split) | Stanford Online Products (SOP) (test) |
| Metric | Recall@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall@1](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test.md?metric=Recall%401>): Higher is better; unit: PERCENT.

- [Recall@10](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test.md?metric=Recall%4010>): Higher is better; unit: PERCENT.

- [Recall@100](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test.md?metric=Recall%40100>): Higher is better; unit: PERCENT.

- [Recall@1000](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test.md?metric=Recall%401000>): Higher is better; unit: PERCENT.

- [Attack Quality (AQ)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test.md?metric=Attack%20Quality%20(AQ)>): Higher is better; unit: SCALAR.

- [Attack Success Rate (ASR)](<https://www.sota2.com/research/sota/black-box-adversarial-attack-image-retrieval-on-stanford-online-products-test.md?metric=Attack%20Success%20Rate%20(ASR)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Recall@1 | Result date | Report paper |
| --- | --- | --- | --- |
| Original | 72.4 | Not recorded | 68fa69901e209131cea22a7f |
| QAIR\_C | 17.6 | Not recorded | 68fa69901e209131cea22a7f |
| QAIR\_{C-I} | 6 | Not recorded | 68fa69901e209131cea22a7f |
| QAIR\_{C-S} | 5.6 | Not recorded | 68fa69901e209131cea22a7f |
| QAIR | 1.6 | Not recorded | 68fa69901e209131cea22a7f |
| QAIR\_{R-S} | 1.6 | Not recorded | 68fa69901e209131cea22a7f |
| OptAttack | 1.2 | Not recorded | 68fa69901e209131cea22a7f |
| Sign-Opt | 0.8 | Not recorded | 68fa69901e209131cea22a7f |
| HSJA | 0 | Not recorded | 68fa69901e209131cea22a7f |

### Original

Recall@1: 72.4. Result ID: 698db6ac8b517eb4332345ee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

Recorded evaluation configuration: {"status":"No attack baseline"}. This record does not assert independent reproduction.

### QAIR\_C

Recall@1: 17.6. Result ID: 698db6ac8b517eb4332345f3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

Recorded evaluation configuration: {"Component Analysis":"Candidate selection only"}. This record does not assert independent reproduction.

### QAIR\_{C-I}

Recall@1: 6. Result ID: 698db6ac8b517eb4332345f4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

Recorded evaluation configuration: {"Component Analysis":"Inter-image relevance"}. This record does not assert independent reproduction.

### QAIR\_{C-S}

Recall@1: 5.6. Result ID: 698db6ac8b517eb4332345f5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

Recorded evaluation configuration: {"Component Analysis":"Sequence importance relevance"}. This record does not assert independent reproduction.

### QAIR

Recall@1: 1.6. Result ID: 698db6ac8b517eb4332345f2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

Recorded evaluation configuration: {"Attack Type":"Proposed"}. This record does not assert independent reproduction.

### QAIR\_{R-S}

Recall@1: 1.6. Result ID: 698db6ac8b517eb4332345f6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

Recorded evaluation configuration: {"Component Analysis":"Full model / Range selection"}. This record does not assert independent reproduction.

### OptAttack

Recall@1: 1.2. Result ID: 698db6ac8b517eb4332345ef.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa649d1e209131cea05942.md>)

Recorded evaluation configuration: {"Attack Type":"Decision-based"}. This record does not assert independent reproduction.

### Sign-Opt

Recall@1: 0.8. Result ID: 698db6ac8b517eb4332345f0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67091e209131cea14055.md>)

Recorded evaluation configuration: {"Attack Type":"Decision-based"}. This record does not assert independent reproduction.

### HSJA

Recall@1: 0. Result ID: 698db6ac8b517eb4332345f1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69901e209131cea22a7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa56db1e209131ce9a05a4.md>)

Recorded evaluation configuration: {"Attack Type":"Decision-based"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
