# Jailbreak Defense on SAP30

Source: [Jailbreak Defense on SAP30](<https://www.sota2.com/research/sota/jailbreak-defense-on-sap30>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:46:23.186Z

Evaluation of model robustness against jailbreak prompts using the SAP30 dataset, measured by Harmful Score and Attack Success Rate (ASR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Jailbreak Defense |
| Dataset (including any stated split) | SAP30 |
| Metric | Harmful Score |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Harmful Score](<https://www.sota2.com/research/sota/jailbreak-defense-on-sap30.md?metric=Harmful%20Score>): Lower is better; unit: SCALAR.

- [ASR](<https://www.sota2.com/research/sota/jailbreak-defense-on-sap30.md?metric=ASR>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Harmful Score | Result date | Report paper |
| --- | --- | --- | --- |
| No Defense | 1 | Not recorded | 68fa74411e209131cea608b7 |
| PPL | 1 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Examination | 1 | Not recorded | 68fa74411e209131cea608b7 |
| Paraphrase | 1 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Reminder | 1 | Not recorded | 68fa74411e209131cea608b7 |
| ICD | 1 | Not recorded | 68fa74411e209131cea608b7 |
| SafeDecoding | 1 | Not recorded | 68fa74411e209131cea608b7 |
| Retokenization | 1.01 | Not recorded | 68fa74411e209131cea608b7 |
| SafeDecoding | 1.34 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Examination | 1.44 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Reminder | 2.75 | Not recorded | 68fa74411e209131cea608b7 |
| ICD | 2.8 | Not recorded | 68fa74411e209131cea608b7 |
| Paraphrase | 3.15 | Not recorded | 68fa74411e209131cea608b7 |
| Retokenization | 3.8 | Not recorded | 68fa74411e209131cea608b7 |
| No Defense | 4.18 | Not recorded | 68fa74411e209131cea608b7 |
| PPL | 4.18 | Not recorded | 68fa74411e209131cea608b7 |

### No Defense

Harmful Score: 1. Result ID: 699337863a6c314849147d4a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### PPL

Harmful Score: 1. Result ID: 699337863a6c314849147d4b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71251e209131cea4f7d4.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Self-Examination

Harmful Score: 1. Result ID: 699337863a6c314849147d4c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Paraphrase

Harmful Score: 1. Result ID: 699337863a6c314849147d4d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Self-Reminder

Harmful Score: 1. Result ID: 699337863a6c314849147d4f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### ICD

Harmful Score: 1. Result ID: 699337863a6c314849147d50.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### SafeDecoding

Harmful Score: 1. Result ID: 699337863a6c314849147d51.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Implementation](<https://github.com/uw-nsl/SafeDecoding>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Retokenization

Harmful Score: 1.01. Result ID: 699337863a6c314849147d4e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### SafeDecoding

Harmful Score: 1.34. Result ID: 699337863a6c314849147d49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Implementation](<https://github.com/uw-nsl/SafeDecoding>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Self-Examination

Harmful Score: 1.44. Result ID: 699337863a6c314849147d44.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Self-Reminder

Harmful Score: 2.75. Result ID: 699337863a6c314849147d47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### ICD

Harmful Score: 2.8. Result ID: 699337863a6c314849147d48.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Paraphrase

Harmful Score: 3.15. Result ID: 699337863a6c314849147d45.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Retokenization

Harmful Score: 3.8. Result ID: 699337863a6c314849147d46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### No Defense

Harmful Score: 4.18. Result ID: 699337863a6c314849147d42.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### PPL

Harmful Score: 4.18. Result ID: 699337863a6c314849147d43.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71251e209131cea4f7d4.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
