# Adversarial Attack on AdvBench 50 harmful behaviors

Source: [Adversarial Attack on AdvBench 50 harmful behaviors](<https://www.sota2.com/research/sota/adversarial-attack-on-advbench-50-harmful-behaviors>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T07:40:09.199Z

Evaluation of adversarial attack performance, typically measured by Attack Success Rate (ASR) and metrics related to failure modes (#FE), on the specific set of 50 harmful behaviors defined in AdvBench.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Adversarial Attack |
| Dataset (including any stated split) | AdvBench 50 harmful behaviors |
| Metric | ASR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ASR](<https://www.sota2.com/research/sota/adversarial-attack-on-advbench-50-harmful-behaviors.md?metric=ASR>): Higher is better; unit: PERCENT.

- [Failure Count](<https://www.sota2.com/research/sota/adversarial-attack-on-advbench-50-harmful-behaviors.md?metric=Failure%20Count>): Higher is better; unit: SCALAR.

## Recorded results

| Method | ASR | Result date | Report paper |
| --- | --- | --- | --- |
| GPTFuzzer | 100 | Not recorded | 68fa79ae1e209131cea7eda0 |
| Algorithm 1 (Greedy Random Search) | 90 | Not recorded | 69fc1cc15497b3b670c88756 |
| VERA | 86 | Not recorded | 68fa79ae1e209131cea7eda0 |
| AutoDAN | 82 | Not recorded | 68fa79ae1e209131cea7eda0 |
| GCG | 72 | Not recorded | 68fa79ae1e209131cea7eda0 |
| Algorithm 1 (Greedy Random Search) | 64 | Not recorded | 69fc1cc15497b3b670c88756 |
| PAIR | 64 | Not recorded | 68fa79ae1e209131cea7eda0 |
| Algorithm 1 (Greedy Random Search) | 62 | Not recorded | 69fc1cc15497b3b670c88756 |
| Algorithm 1 (Greedy Random Search) | 52 | Not recorded | 69fc1cc15497b3b670c88756 |
| VERA | 16 | Not recorded | 68fa79ae1e209131cea7eda0 |
| AutoDAN | 12 | Not recorded | 68fa79ae1e209131cea7eda0 |
| GPTFuzzer | 12 | Not recorded | 68fa79ae1e209131cea7eda0 |
| GCG | 10 | Not recorded | 68fa79ae1e209131cea7eda0 |
| PAIR | 8 | Not recorded | 68fa79ae1e209131cea7eda0 |

### GPTFuzzer

ASR: 100. Result ID: 6a1e88d1fbc373592c185a4e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73d41e209131cea5e61e.md>)

Recorded evaluation configuration: {"Target Model":"Vicuna-7B"}. This record does not assert independent reproduction.

### Algorithm 1 (Greedy Random Search)

ASR: 90. Result ID: 69fc370247f34ce924de8510.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

Recorded evaluation configuration: {"Target Model":"Mistral 7B"}. This record does not assert independent reproduction.

### VERA

ASR: 86. Result ID: 6a1e88d1fbc373592c185a52.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

Recorded evaluation configuration: {"Target Model":"Vicuna-7B"}. This record does not assert independent reproduction.

### AutoDAN

ASR: 82. Result ID: 6a1e88d1fbc373592c185a4c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72931e209131cea573c9.md>)

Recorded evaluation configuration: {"Target Model":"Vicuna-7B"}. This record does not assert independent reproduction.

### GCG

ASR: 72. Result ID: 6a1e88d1fbc373592c185a4a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71861e209131cea51c3b.md>)

Recorded evaluation configuration: {"Target Model":"Vicuna-7B"}. This record does not assert independent reproduction.

### Algorithm 1 (Greedy Random Search)

ASR: 64. Result ID: 69fc370247f34ce924de850f.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

Recorded evaluation configuration: {"Target Model":"Qwen 2.5 7B"}. This record does not assert independent reproduction.

### PAIR

ASR: 64. Result ID: 6a1e88d1fbc373592c185a50.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74311e209131cea60579.md>)

Recorded evaluation configuration: {"Target Model":"Vicuna-7B"}. This record does not assert independent reproduction.

### Algorithm 1 (Greedy Random Search)

ASR: 62. Result ID: 69fc370247f34ce924de850e.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

Recorded evaluation configuration: {"Target Model":"LLaMA 2 Chat 7B"}. This record does not assert independent reproduction.

### Algorithm 1 (Greedy Random Search)

ASR: 52. Result ID: 69fc370247f34ce924de850d.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cc15497b3b670c88756.md>)

Recorded evaluation configuration: {"Target Model":"Gemma 7B"}. This record does not assert independent reproduction.

### VERA

ASR: 16. Result ID: 6a1e88d1fbc373592c185a51.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

Recorded evaluation configuration: {"Target Model":"LLaMA2-7B-Chat"}. This record does not assert independent reproduction.

### AutoDAN

ASR: 12. Result ID: 6a1e88d1fbc373592c185a4b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72931e209131cea573c9.md>)

Recorded evaluation configuration: {"Target Model":"LLaMA2-7B-Chat"}. This record does not assert independent reproduction.

### GPTFuzzer

ASR: 12. Result ID: 6a1e88d1fbc373592c185a4d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73d41e209131cea5e61e.md>)

Recorded evaluation configuration: {"Target Model":"LLaMA2-7B-Chat"}. This record does not assert independent reproduction.

### GCG

ASR: 10. Result ID: 6a1e88d1fbc373592c185a49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71861e209131cea51c3b.md>)

Recorded evaluation configuration: {"Target Model":"LLaMA2-7B-Chat"}. This record does not assert independent reproduction.

### PAIR

ASR: 8. Result ID: 6a1e88d1fbc373592c185a4f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79ae1e209131cea7eda0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74311e209131cea60579.md>)

Recorded evaluation configuration: {"Target Model":"LLaMA2-7B-Chat"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
