# Visual Jailbreaking Attack on MaliciousInstruct

Source: [Visual Jailbreaking Attack on MaliciousInstruct](<https://www.sota2.com/research/sota/visual-jailbreaking-attack-on-maliciousinstruct>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-04T08:03:34.754Z

Evaluation of model robustness against visual jailbreaking attacks using the MaliciousInstruct dataset, measured by Attack Success Rate (ASR) and Query success rate.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Visual Jailbreaking Attack |
| Dataset (including any stated split) | MaliciousInstruct |
| Metric | ASR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 61 of 61 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ASR](<https://www.sota2.com/research/sota/visual-jailbreaking-attack-on-maliciousinstruct.md?metric=ASR>): Higher is better; unit: PERCENT.

- [Query Success Rate](<https://www.sota2.com/research/sota/visual-jailbreaking-attack-on-maliciousinstruct.md?metric=Query%20Success%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ASR | Result date | Report paper |
| --- | --- | --- | --- |
| FORCE | 92 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 92 | Not recorded | 68fa7ba81e209131cea89b04 |
| DI-PGD | 92 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 92 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 84 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 84 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 84 | Not recorded | 68fa7ba81e209131cea89b04 |
| MLAI | 80 | Not recorded | 68fa7ba81e209131cea89b04 |
| MI-PGD | 78 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 69 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 69 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 69 | Not recorded | 68fa7ba81e209131cea89b04 |
| MLAI | 66 | Not recorded | 68fa7ba81e209131cea89b04 |
| DI-PGD | 65 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 64 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 64 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 64 | Not recorded | 68fa7ba81e209131cea89b04 |
| DI-PGD | 62 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 61 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 61 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 61 | Not recorded | 68fa7ba81e209131cea89b04 |
| MLAI | 61 | Not recorded | 68fa7ba81e209131cea89b04 |
| Ensemble | 60 | Not recorded | 68fa7ba81e209131cea89b04 |
| MI-PGD | 60 | Not recorded | 68fa7ba81e209131cea89b04 |
| Ensemble | 59 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 53 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 53 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 53 | Not recorded | 68fa7ba81e209131cea89b04 |
| MI-PGD | 49 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 11 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 11 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 11 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 10 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 10 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 10 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 10 | Not recorded | 68fa7ba81e209131cea89b04 |
| DI-PGD | 9 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 5 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 5 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 5 | Not recorded | 68fa7ba81e209131cea89b04 |
| MI-PGD | 5 | Not recorded | 68fa7ba81e209131cea89b04 |
| Ensemble | 4 | Not recorded | 68fa7ba81e209131cea89b04 |
| MLAI | 3 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 2 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 2 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 2 | Not recorded | 694cc4e953fdd5c36173a68a |
| FORCE | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| Ensemble | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| MI-PGD | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| DI-PGD | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| MLAI | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| FORCE | 2 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 1 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 1 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 1 | Not recorded | 694cc4e953fdd5c36173a68a |
| PGD | 1 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 1 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 1 | Not recorded | 68fa7ba81e209131cea89b04 |
| PGD | 1 | Not recorded | 68fa7ba81e209131cea89b04 |

### FORCE

ASR: 92. Result ID: 699941505698665ec4ab6250.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"InstructBlip-Vicuna-7B"}. This record does not assert independent reproduction.

### FORCE

ASR: 92. Result ID: 69a7e7536dbb7075b94c9971.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"InstructBlip-Vicuna-7B"}. This record does not assert independent reproduction.

### DI-PGD

ASR: 92. Result ID: 69a7e7536dbb7075b94c99a6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65dc1e209131cea0ceaa.md>)

Recorded evaluation configuration: {"Target Model":"InstructBlip"}. This record does not assert independent reproduction.

### FORCE

ASR: 92. Result ID: 69a7e7536dbb7075b94c99a8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"InstructBlip"}. This record does not assert independent reproduction.

### PGD

ASR: 84. Result ID: 699941505698665ec4ab624f.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"InstructBlip-Vicuna-7B"}. This record does not assert independent reproduction.

### PGD

ASR: 84. Result ID: 69a7e7536dbb7075b94c9970.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"InstructBlip-Vicuna-7B"}. This record does not assert independent reproduction.

### PGD

ASR: 84. Result ID: 69a7e7536dbb7075b94c99a4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Target Model":"InstructBlip"}. This record does not assert independent reproduction.

### MLAI

ASR: 80. Result ID: 69a7e7536dbb7075b94c99a7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e01e209131cea6a5f0.md>)

Recorded evaluation configuration: {"Target Model":"InstructBlip"}. This record does not assert independent reproduction.

### MI-PGD

ASR: 78. Result ID: 69a7e7536dbb7075b94c99a5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e98.md>)

Recorded evaluation configuration: {"Target Model":"InstructBlip"}. This record does not assert independent reproduction.

### FORCE

ASR: 69. Result ID: 699941505698665ec4ab624e.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Llava-v1.6-mistral-7b"}. This record does not assert independent reproduction.

### FORCE

ASR: 69. Result ID: 69a7e7536dbb7075b94c996f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Llava-v1.6-mistral-7b"}. This record does not assert independent reproduction.

### FORCE

ASR: 69. Result ID: 69a7e7536dbb7075b94c99a3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Llava-v1.6"}. This record does not assert independent reproduction.

### MLAI

ASR: 66. Result ID: 69a7e7536dbb7075b94c99a2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e01e209131cea6a5f0.md>)

Recorded evaluation configuration: {"Target Model":"Llava-v1.6"}. This record does not assert independent reproduction.

### DI-PGD

ASR: 65. Result ID: 69a7e7536dbb7075b94c99a1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65dc1e209131cea0ceaa.md>)

Recorded evaluation configuration: {"Target Model":"Llava-v1.6"}. This record does not assert independent reproduction.

### FORCE

ASR: 64. Result ID: 699941505698665ec4ab6252.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Idefics3-8B-Llama3"}. This record does not assert independent reproduction.

### FORCE

ASR: 64. Result ID: 69a7e7536dbb7075b94c9973.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Idefics3-8B-Llama3"}. This record does not assert independent reproduction.

### FORCE

ASR: 64. Result ID: 69a7e7536dbb7075b94c99ae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Idefics3"}. This record does not assert independent reproduction.

### DI-PGD

ASR: 62. Result ID: 69a7e7536dbb7075b94c99ac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65dc1e209131cea0ceaa.md>)

Recorded evaluation configuration: {"Target Model":"Idefics3"}. This record does not assert independent reproduction.

### PGD

ASR: 61. Result ID: 699941505698665ec4ab624d.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Llava-v1.6-mistral-7b"}. This record does not assert independent reproduction.

### PGD

ASR: 61. Result ID: 69a7e7536dbb7075b94c996e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Llava-v1.6-mistral-7b"}. This record does not assert independent reproduction.

### PGD

ASR: 61. Result ID: 69a7e7536dbb7075b94c999e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Target Model":"Llava-v1.6"}. This record does not assert independent reproduction.

### MLAI

ASR: 61. Result ID: 69a7e7536dbb7075b94c99ad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e01e209131cea6a5f0.md>)

Recorded evaluation configuration: {"Target Model":"Idefics3"}. This record does not assert independent reproduction.

### Ensemble

ASR: 60. Result ID: 69a7e7536dbb7075b94c99aa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Idefics3"}. This record does not assert independent reproduction.

### MI-PGD

ASR: 60. Result ID: 69a7e7536dbb7075b94c99ab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e98.md>)

Recorded evaluation configuration: {"Target Model":"Idefics3"}. This record does not assert independent reproduction.

### Ensemble

ASR: 59. Result ID: 69a7e7536dbb7075b94c999f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Llava-v1.6"}. This record does not assert independent reproduction.

### PGD

ASR: 53. Result ID: 699941505698665ec4ab6251.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Idefics3-8B-Llama3"}. This record does not assert independent reproduction.

### PGD

ASR: 53. Result ID: 69a7e7536dbb7075b94c9972.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Adapter-Based MLLMs","Target Model":"Idefics3-8B-Llama3"}. This record does not assert independent reproduction.

### PGD

ASR: 53. Result ID: 69a7e7536dbb7075b94c99a9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Target Model":"Idefics3"}. This record does not assert independent reproduction.

### MI-PGD

ASR: 49. Result ID: 69a7e7536dbb7075b94c99a0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e98.md>)

Recorded evaluation configuration: {"Target Model":"Llava-v1.6"}. This record does not assert independent reproduction.

### FORCE

ASR: 11. Result ID: 699941505698665ec4ab6256.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Qwen2.5-VL-7B-Instruct"}. This record does not assert independent reproduction.

### FORCE

ASR: 11. Result ID: 69a7e7536dbb7075b94c9977.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Qwen2.5-VL-7B-Instruct"}. This record does not assert independent reproduction.

### FORCE

ASR: 11. Result ID: 69a7e7536dbb7075b94c99ba.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Qwen2.5-VL"}. This record does not assert independent reproduction.

### PGD

ASR: 10. Result ID: 699941505698665ec4ab6259.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Gemini-2.5-Pro"}. This record does not assert independent reproduction.

### FORCE

ASR: 10. Result ID: 699941505698665ec4ab625a.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Gemini-2.5-Pro"}. This record does not assert independent reproduction.

### PGD

ASR: 10. Result ID: 69a7e7536dbb7075b94c997a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Gemini-2.5-Pro"}. This record does not assert independent reproduction.

### FORCE

ASR: 10. Result ID: 69a7e7536dbb7075b94c997b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Gemini-2.5-Pro"}. This record does not assert independent reproduction.

### DI-PGD

ASR: 9. Result ID: 69a7e7536dbb7075b94c99b8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65dc1e209131cea0ceaa.md>)

Recorded evaluation configuration: {"Target Model":"Qwen2.5-VL"}. This record does not assert independent reproduction.

### PGD

ASR: 5. Result ID: 699941505698665ec4ab6255.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Qwen2.5-VL-7B-Instruct"}. This record does not assert independent reproduction.

### PGD

ASR: 5. Result ID: 69a7e7536dbb7075b94c9976.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Qwen2.5-VL-7B-Instruct"}. This record does not assert independent reproduction.

### PGD

ASR: 5. Result ID: 69a7e7536dbb7075b94c99b5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Target Model":"Qwen2.5-VL"}. This record does not assert independent reproduction.

### MI-PGD

ASR: 5. Result ID: 69a7e7536dbb7075b94c99b7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e98.md>)

Recorded evaluation configuration: {"Target Model":"Qwen2.5-VL"}. This record does not assert independent reproduction.

### Ensemble

ASR: 4. Result ID: 69a7e7536dbb7075b94c99b6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Qwen2.5-VL"}. This record does not assert independent reproduction.

### MLAI

ASR: 3. Result ID: 69a7e7536dbb7075b94c99b9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e01e209131cea6a5f0.md>)

Recorded evaluation configuration: {"Target Model":"Qwen2.5-VL"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 699941505698665ec4ab6254.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Llama-3.2-11B-Vision-Instruct"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 699941505698665ec4ab6258.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Claude-Sonnet-4"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 699941505698665ec4ab625c.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"GPT-5"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 69a7e7536dbb7075b94c9975.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Llama-3.2-11B-Vision-Instruct"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 69a7e7536dbb7075b94c9979.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Claude-Sonnet-4"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 69a7e7536dbb7075b94c997d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"GPT-5"}. This record does not assert independent reproduction.

### Ensemble

ASR: 2. Result ID: 69a7e7536dbb7075b94c99b0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Llama-3.2"}. This record does not assert independent reproduction.

### MI-PGD

ASR: 2. Result ID: 69a7e7536dbb7075b94c99b1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64261e209131cea02e98.md>)

Recorded evaluation configuration: {"Target Model":"Llama-3.2"}. This record does not assert independent reproduction.

### DI-PGD

ASR: 2. Result ID: 69a7e7536dbb7075b94c99b2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65dc1e209131cea0ceaa.md>)

Recorded evaluation configuration: {"Target Model":"Llama-3.2"}. This record does not assert independent reproduction.

### MLAI

ASR: 2. Result ID: 69a7e7536dbb7075b94c99b3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e01e209131cea6a5f0.md>)

Recorded evaluation configuration: {"Target Model":"Llama-3.2"}. This record does not assert independent reproduction.

### FORCE

ASR: 2. Result ID: 69a7e7536dbb7075b94c99b4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

Recorded evaluation configuration: {"Target Model":"Llama-3.2"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 699941505698665ec4ab6253.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Llama-3.2-11B-Vision-Instruct"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 699941505698665ec4ab6257.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Claude-Sonnet-4"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 699941505698665ec4ab625b.

[Reporting paper](<https://www.sota2.com/research/paper/694cc4e953fdd5c36173a68a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"GPT-5"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 69a7e7536dbb7075b94c9974.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Early-Fusion MLLMs","Target Model":"Llama-3.2-11B-Vision-Instruct"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 69a7e7536dbb7075b94c9978.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"Claude-Sonnet-4"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 69a7e7536dbb7075b94c997c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Architecture":"Commercial MLLMs","Target Model":"GPT-5"}. This record does not assert independent reproduction.

### PGD

ASR: 1. Result ID: 69a7e7536dbb7075b94c99af.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7ba81e209131cea89b04.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa665a1e209131cea0fbae.md>)

Recorded evaluation configuration: {"Target Model":"Llama-3.2"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
