# Jailbreak Detection on AutoDAN (ASR/PGR)

Source: [Jailbreak Detection on AutoDAN (ASR/PGR)](<https://www.sota2.com/research/sota/jailbreak-detection-on-autodan-asr-pgr>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-03T07:28:05.712Z

Evaluation of a model's ability to detect adversarial jailbreak prompts generated using the AutoDAN methodology, measured by ASR (Attack Success Rate) and PGR.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Jailbreak Detection |
| Dataset (including any stated split) | AutoDAN |
| Metric | Attack Success Rate (ASR) |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Attack Success Rate (ASR)](<https://www.sota2.com/research/sota/jailbreak-detection-on-autodan-asr-pgr.md?metric=Attack%20Success%20Rate%20(ASR)>): Lower is better; unit: PERCENT.

- [PGR](<https://www.sota2.com/research/sota/jailbreak-detection-on-autodan-asr-pgr.md?metric=PGR>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Attack Success Rate (ASR) | Result date | Report paper |
| --- | --- | --- | --- |
| GradientCuff | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| Token Highlighter | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| SelfDefend (Direct) | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| WildGuard (Pre) | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| GuardReasoner (Pre) | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| GuardReasoner (Post) | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| SelfGrader | 0 | Not recorded | 69cf49700636e5bf4afcd91d |
| GradSafe | 1 | Not recorded | 69cf49700636e5bf4afcd91d |
| SelfDefend (Intent) | 1 | Not recorded | 69cf49700636e5bf4afcd91d |
| WildGuard (Post) | 1 | Not recorded | 69cf49700636e5bf4afcd91d |
| LLama-3-8B-Instruct (No Defense) | 2 | Not recorded | 69cf49700636e5bf4afcd91d |
| Perplexity Filter | 2 | Not recorded | 69cf49700636e5bf4afcd91d |
| Prompt Guard | 2 | Not recorded | 69cf49700636e5bf4afcd91d |
| Llama Guard (Pre) | 2 | Not recorded | 69cf49700636e5bf4afcd91d |
| Llama Guard (Post) | 2 | Not recorded | 69cf49700636e5bf4afcd91d |

### GradientCuff

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e722.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa759c1e209131cea68f0e.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"19.26","Memory Overhead (MB)":"1223.19"}. This record does not assert independent reproduction.

### Token Highlighter

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e723.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76591e209131cea6c86a.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"15.20","Memory Overhead (MB)":"65536.66"}. This record does not assert independent reproduction.

### SelfDefend (Direct)

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e727.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76d81e209131cea6f824.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"0.80","Memory Overhead (MB)":"13241.86"}. This record does not assert independent reproduction.

### WildGuard (Pre)

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e729.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76291e209131cea6b9a6.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"2.74","Memory Overhead (MB)":"28014.70"}. This record does not assert independent reproduction.

### GuardReasoner (Pre)

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e72b.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c491e209131cea8d665.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"11.90","Memory Overhead (MB)":"15317.41"}. This record does not assert independent reproduction.

### GuardReasoner (Post)

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e72c.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c491e209131cea8d665.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"13.14","Memory Overhead (MB)":"15317.42"}. This record does not assert independent reproduction.

### SelfGrader

Attack Success Rate (ASR): 0. Result ID: 69cf6bf247f34ce924b8e72d.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"0.78","Memory Overhead (MB)":"377.61"}. This record does not assert independent reproduction.

### GradSafe

Attack Success Rate (ASR): 1. Result ID: 69cf6bf247f34ce924b8e721.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c676.md>)

[Implementation](<https://github.com/xyq7/GradSafe>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SelfDefend (Intent)

Attack Success Rate (ASR): 1. Result ID: 69cf6bf247f34ce924b8e728.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76d81e209131cea6f824.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"2.38","Memory Overhead (MB)":"13247.35"}. This record does not assert independent reproduction.

### WildGuard (Post)

Attack Success Rate (ASR): 1. Result ID: 69cf6bf247f34ce924b8e72a.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76291e209131cea6b9a6.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"2.78","Memory Overhead (MB)":"28098.39"}. This record does not assert independent reproduction.

### LLama-3-8B-Instruct (No Defense)

Attack Success Rate (ASR): 2. Result ID: 69cf6bf247f34ce924b8e71f.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"0.86"}. This record does not assert independent reproduction.

### Perplexity Filter

Attack Success Rate (ASR): 2. Result ID: 69cf6bf247f34ce924b8e720.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa707f1e209131cea4b7c6.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"0.27","Memory Overhead (MB)":"13279.46"}. This record does not assert independent reproduction.

### Prompt Guard

Attack Success Rate (ASR): 2. Result ID: 69cf6bf247f34ce924b8e724.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"16.87","Memory Overhead (MB)":"1064.71"}. This record does not assert independent reproduction.

### Llama Guard (Pre)

Attack Success Rate (ASR): 2. Result ID: 69cf6bf247f34ce924b8e725.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea5186d.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"0.62","Memory Overhead (MB)":"13697.27"}. This record does not assert independent reproduction.

### Llama Guard (Post)

Attack Success Rate (ASR): 2. Result ID: 69cf6bf247f34ce924b8e726.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49700636e5bf4afcd91d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea5186d.md>)

Recorded evaluation configuration: {"Latency (Sec.)":"0.70","Memory Overhead (MB)":"13783.60"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
