# Adversarial Attack on Medical Imaging Dataset 1,000 images 1.0 (test)

Source: [Adversarial Attack on Medical Imaging Dataset 1,000 images 1.0 (test)](<https://www.sota2.com/research/sota/adversarial-attack-on-medical-imaging-dataset-1-000-images-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-21T10:15:35.511Z

Evaluation of adversarial attack performance using MTR, Average Similarity (AvgSim), and Model Attack Success (MAS) metrics on the test split of the Medical Imaging Dataset 1,000 images version 1.0.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Adversarial Attack |
| Dataset (including any stated split) | Medical Imaging Dataset 1,000 images 1.0 (test) |
| Metric | MTR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 36 of 36 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MTR](<https://www.sota2.com/research/sota/adversarial-attack-on-medical-imaging-dataset-1-000-images-1-0-test.md?metric=MTR>): Higher is better; unit: PERCENT.

- [AvgSim](<https://www.sota2.com/research/sota/adversarial-attack-on-medical-imaging-dataset-1-000-images-1-0-test.md?metric=AvgSim>): Higher is better; unit: PERCENT.

- [MAS](<https://www.sota2.com/research/sota/adversarial-attack-on-medical-imaging-dataset-1-000-images-1-0-test.md?metric=MAS>): Higher is better; unit: PERCENT.

## Recorded results

| Method | MTR | Result date | Report paper |
| --- | --- | --- | --- |
| MedFocusLeak | 79 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MedFocusLeak | 75 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MAttack | 69 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MedFocusLeak | 68 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AnyAttack | 66 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MAttack | 66 | Not recorded | 69e7049c7d0172140ec7ed5b |
| FOA-Attack | 64 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AttackVLM | 63 | Not recorded | 69e7049c7d0172140ec7ed5b |
| FOA-Attack | 63 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AttackVLM | 63 | Not recorded | 69e7049c7d0172140ec7ed5b |
| Attack Bard | 62 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AttackVLM | 62 | Not recorded | 69e7049c7d0172140ec7ed5b |
| Attack Bard | 59 | Not recorded | 69e7049c7d0172140ec7ed5b |
| FOA-Attack | 59 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AnyAttack | 57 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MAttack | 56 | Not recorded | 69e7049c7d0172140ec7ed5b |
| Attack Bard | 55 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AnyAttack | 54 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MedFocusLeak | 48 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MedFocusLeak | 48 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AnyAttack | 41 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MedFocusLeak | 40 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AttackVLM | 40 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AnyAttack | 39 | Not recorded | 69e7049c7d0172140ec7ed5b |
| Attack Bard | 37 | Not recorded | 69e7049c7d0172140ec7ed5b |
| Attack Bard | 35 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AnyAttack | 35 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MAttack | 34 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AttackVLM | 33 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MAttack | 33 | Not recorded | 69e7049c7d0172140ec7ed5b |
| AttackVLM | 32 | Not recorded | 69e7049c7d0172140ec7ed5b |
| MAttack | 31 | Not recorded | 69e7049c7d0172140ec7ed5b |
| Attack Bard | 29 | Not recorded | 69e7049c7d0172140ec7ed5b |
| FOA-Attack | 29 | Not recorded | 69e7049c7d0172140ec7ed5b |
| FOA-Attack | 16 | Not recorded | 69e7049c7d0172140ec7ed5b |
| FOA-Attack | 7 | Not recorded | 69e7049c7d0172140ec7ed5b |

### MedFocusLeak

MTR: 79. Result ID: 69e74d0547f34ce924ce1db9.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Implementation](<https://github.com/AkashGhosh/When-Background-Matters-Breaking-Medical-Vision-Language-Models-by-Transferable-Attack>)

Recorded evaluation configuration: {"Target Model":"InternVL-8B"}. This record does not assert independent reproduction.

### MedFocusLeak

MTR: 75. Result ID: 69e74d0547f34ce924ce1dbf.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Implementation](<https://github.com/AkashGhosh/When-Background-Matters-Breaking-Medical-Vision-Language-Models-by-Transferable-Attack>)

Recorded evaluation configuration: {"Target Model":"QwenVL-7B"}. This record does not assert independent reproduction.

### MAttack

MTR: 69. Result ID: 69e74d0547f34ce924ce1db7.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77631e209131cea72ed2.md>)

Recorded evaluation configuration: {"Target Model":"InternVL-8B"}. This record does not assert independent reproduction.

### MedFocusLeak

MTR: 68. Result ID: 69e74d0547f34ce924ce1dc5.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Implementation](<https://github.com/AkashGhosh/When-Background-Matters-Breaking-Medical-Vision-Language-Models-by-Transferable-Attack>)

Recorded evaluation configuration: {"Target Model":"BioMedLlama-Vision"}. This record does not assert independent reproduction.

### AnyAttack

MTR: 66. Result ID: 69e74d0547f34ce924ce1dbb.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f7e.md>)

Recorded evaluation configuration: {"Target Model":"QwenVL-7B"}. This record does not assert independent reproduction.

### MAttack

MTR: 66. Result ID: 69e74d0547f34ce924ce1dbd.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77631e209131cea72ed2.md>)

Recorded evaluation configuration: {"Target Model":"QwenVL-7B"}. This record does not assert independent reproduction.

### FOA-Attack

MTR: 64. Result ID: 69e74d0547f34ce924ce1dbe.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a947.md>)

Recorded evaluation configuration: {"Target Model":"QwenVL-7B"}. This record does not assert independent reproduction.

### AttackVLM

MTR: 63. Result ID: 69e74d0547f34ce924ce1db6.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e81e.md>)

[Implementation](<https://yunqing-me.github.io/AttackVLM/>)

Recorded evaluation configuration: {"Target Model":"InternVL-8B"}. This record does not assert independent reproduction.

### FOA-Attack

MTR: 63. Result ID: 69e74d0547f34ce924ce1db8.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a947.md>)

Recorded evaluation configuration: {"Target Model":"InternVL-8B"}. This record does not assert independent reproduction.

### AttackVLM

MTR: 63. Result ID: 69e74d0547f34ce924ce1dbc.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e81e.md>)

[Implementation](<https://yunqing-me.github.io/AttackVLM/>)

Recorded evaluation configuration: {"Target Model":"QwenVL-7B"}. This record does not assert independent reproduction.

### Attack Bard

MTR: 62. Result ID: 69e74d0547f34ce924ce1dc0.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de80.md>)

Recorded evaluation configuration: {"Target Model":"BioMedLlama-Vision"}. This record does not assert independent reproduction.

### AttackVLM

MTR: 62. Result ID: 69e74d0547f34ce924ce1dc2.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e81e.md>)

[Implementation](<https://yunqing-me.github.io/AttackVLM/>)

Recorded evaluation configuration: {"Target Model":"BioMedLlama-Vision"}. This record does not assert independent reproduction.

### Attack Bard

MTR: 59. Result ID: 69e74d0547f34ce924ce1dba.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de80.md>)

Recorded evaluation configuration: {"Target Model":"QwenVL-7B"}. This record does not assert independent reproduction.

### FOA-Attack

MTR: 59. Result ID: 69e74d0547f34ce924ce1dc4.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a947.md>)

Recorded evaluation configuration: {"Target Model":"BioMedLlama-Vision"}. This record does not assert independent reproduction.

### AnyAttack

MTR: 57. Result ID: 69e74d0547f34ce924ce1dc1.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f7e.md>)

Recorded evaluation configuration: {"Target Model":"BioMedLlama-Vision"}. This record does not assert independent reproduction.

### MAttack

MTR: 56. Result ID: 69e74d0547f34ce924ce1dc3.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77631e209131cea72ed2.md>)

Recorded evaluation configuration: {"Target Model":"BioMedLlama-Vision"}. This record does not assert independent reproduction.

### Attack Bard

MTR: 55. Result ID: 69e74d0547f34ce924ce1db4.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de80.md>)

Recorded evaluation configuration: {"Target Model":"InternVL-8B"}. This record does not assert independent reproduction.

### AnyAttack

MTR: 54. Result ID: 69e74d0547f34ce924ce1db5.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f7e.md>)

Recorded evaluation configuration: {"Target Model":"InternVL-8B"}. This record does not assert independent reproduction.

### MedFocusLeak

MTR: 48. Result ID: 69e74d0547f34ce924ce1dcb.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Implementation](<https://github.com/AkashGhosh/When-Background-Matters-Breaking-Medical-Vision-Language-Models-by-Transferable-Attack>)

Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro thinking"}. This record does not assert independent reproduction.

### MedFocusLeak

MTR: 48. Result ID: 69e74d0547f34ce924ce1dd7.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Implementation](<https://github.com/AkashGhosh/When-Background-Matters-Breaking-Medical-Vision-Language-Models-by-Transferable-Attack>)

Recorded evaluation configuration: {"Target Model":"GPT-5"}. This record does not assert independent reproduction.

### AnyAttack

MTR: 41. Result ID: 69e74d0547f34ce924ce1dc7.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f7e.md>)

Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro thinking"}. This record does not assert independent reproduction.

### MedFocusLeak

MTR: 40. Result ID: 69e74d0547f34ce924ce1dd1.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Implementation](<https://github.com/AkashGhosh/When-Background-Matters-Breaking-Medical-Vision-Language-Models-by-Transferable-Attack>)

Recorded evaluation configuration: {"Target Model":"MedVLM-R1"}. This record does not assert independent reproduction.

### AttackVLM

MTR: 40. Result ID: 69e74d0547f34ce924ce1dd4.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e81e.md>)

[Implementation](<https://yunqing-me.github.io/AttackVLM/>)

Recorded evaluation configuration: {"Target Model":"GPT-5"}. This record does not assert independent reproduction.

### AnyAttack

MTR: 39. Result ID: 69e74d0547f34ce924ce1dd3.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f7e.md>)

Recorded evaluation configuration: {"Target Model":"GPT-5"}. This record does not assert independent reproduction.

### Attack Bard

MTR: 37. Result ID: 69e74d0547f34ce924ce1dd2.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de80.md>)

Recorded evaluation configuration: {"Target Model":"GPT-5"}. This record does not assert independent reproduction.

### Attack Bard

MTR: 35. Result ID: 69e74d0547f34ce924ce1dc6.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de80.md>)

Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro thinking"}. This record does not assert independent reproduction.

### AnyAttack

MTR: 35. Result ID: 69e74d0547f34ce924ce1dcd.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f7e.md>)

Recorded evaluation configuration: {"Target Model":"MedVLM-R1"}. This record does not assert independent reproduction.

### MAttack

MTR: 34. Result ID: 69e74d0547f34ce924ce1dd5.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77631e209131cea72ed2.md>)

Recorded evaluation configuration: {"Target Model":"GPT-5"}. This record does not assert independent reproduction.

### AttackVLM

MTR: 33. Result ID: 69e74d0547f34ce924ce1dc8.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e81e.md>)

[Implementation](<https://yunqing-me.github.io/AttackVLM/>)

Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro thinking"}. This record does not assert independent reproduction.

### MAttack

MTR: 33. Result ID: 69e74d0547f34ce924ce1dcf.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77631e209131cea72ed2.md>)

Recorded evaluation configuration: {"Target Model":"MedVLM-R1"}. This record does not assert independent reproduction.

### AttackVLM

MTR: 32. Result ID: 69e74d0547f34ce924ce1dce.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e81e.md>)

[Implementation](<https://yunqing-me.github.io/AttackVLM/>)

Recorded evaluation configuration: {"Target Model":"MedVLM-R1"}. This record does not assert independent reproduction.

### MAttack

MTR: 31. Result ID: 69e74d0547f34ce924ce1dc9.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77631e209131cea72ed2.md>)

Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro thinking"}. This record does not assert independent reproduction.

### Attack Bard

MTR: 29. Result ID: 69e74d0547f34ce924ce1dcc.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e91e209131cea4de80.md>)

Recorded evaluation configuration: {"Target Model":"MedVLM-R1"}. This record does not assert independent reproduction.

### FOA-Attack

MTR: 29. Result ID: 69e74d0547f34ce924ce1dd0.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a947.md>)

Recorded evaluation configuration: {"Target Model":"MedVLM-R1"}. This record does not assert independent reproduction.

### FOA-Attack

MTR: 16. Result ID: 69e74d0547f34ce924ce1dca.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a947.md>)

Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro thinking"}. This record does not assert independent reproduction.

### FOA-Attack

MTR: 7. Result ID: 69e74d0547f34ce924ce1dd6.

[Reporting paper](<https://www.sota2.com/research/paper/69e7049c7d0172140ec7ed5b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a947.md>)

Recorded evaluation configuration: {"Target Model":"GPT-5"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
