# Jailbreak Defense on Template

Source: [Jailbreak Defense on Template](<https://www.sota2.com/research/sota/jailbreak-defense-on-template>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:46:23.206Z

Evaluation of model robustness against jailbreak prompts using the Template dataset, measured by Harmful Score and Attack Success Rate (ASR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Jailbreak Defense |
| Dataset (including any stated split) | Template |
| Metric | Harmful Score |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Harmful Score](<https://www.sota2.com/research/sota/jailbreak-defense-on-template.md?metric=Harmful%20Score>): Lower is better; unit: SCALAR.

- [ASR](<https://www.sota2.com/research/sota/jailbreak-defense-on-template.md?metric=ASR>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Harmful Score | Result date | Report paper |
| --- | --- | --- | --- |
| Self-Reminder | 1.02 | Not recorded | 68fa74411e209131cea608b7 |
| SafeDecoding | 1.02 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Examination | 1.03 | Not recorded | 68fa74411e209131cea608b7 |
| Retokenization | 1.03 | Not recorded | 68fa74411e209131cea608b7 |
| ICD | 1.05 | Not recorded | 68fa74411e209131cea608b7 |
| No Defense | 1.06 | Not recorded | 68fa74411e209131cea608b7 |
| PPL | 1.06 | Not recorded | 68fa74411e209131cea608b7 |
| Paraphrase | 1.1 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Examination | 1.44 | Not recorded | 68fa74411e209131cea608b7 |
| SafeDecoding | 1.44 | Not recorded | 68fa74411e209131cea608b7 |
| Paraphrase | 2.31 | Not recorded | 68fa74411e209131cea608b7 |
| Retokenization | 2.58 | Not recorded | 68fa74411e209131cea608b7 |
| Self-Reminder | 3.55 | Not recorded | 68fa74411e209131cea608b7 |
| ICD | 3.56 | Not recorded | 68fa74411e209131cea608b7 |
| No Defense | 3.63 | Not recorded | 68fa74411e209131cea608b7 |
| PPL | 3.63 | Not recorded | 68fa74411e209131cea608b7 |

### Self-Reminder

Harmful Score: 1.02. Result ID: 699337863a6c314849147d5f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### SafeDecoding

Harmful Score: 1.02. Result ID: 699337863a6c314849147d61.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Implementation](<https://github.com/uw-nsl/SafeDecoding>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Self-Examination

Harmful Score: 1.03. Result ID: 699337863a6c314849147d5c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Retokenization

Harmful Score: 1.03. Result ID: 699337863a6c314849147d5e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### ICD

Harmful Score: 1.05. Result ID: 699337863a6c314849147d60.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### No Defense

Harmful Score: 1.06. Result ID: 699337863a6c314849147d5a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### PPL

Harmful Score: 1.06. Result ID: 699337863a6c314849147d5b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71251e209131cea4f7d4.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Paraphrase

Harmful Score: 1.1. Result ID: 699337863a6c314849147d5d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Llama2"}. This record does not assert independent reproduction.

### Self-Examination

Harmful Score: 1.44. Result ID: 699337863a6c314849147d54.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### SafeDecoding

Harmful Score: 1.44. Result ID: 699337863a6c314849147d59.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Implementation](<https://github.com/uw-nsl/SafeDecoding>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Paraphrase

Harmful Score: 2.31. Result ID: 699337863a6c314849147d55.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Retokenization

Harmful Score: 2.58. Result ID: 699337863a6c314849147d56.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### Self-Reminder

Harmful Score: 3.55. Result ID: 699337863a6c314849147d57.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### ICD

Harmful Score: 3.56. Result ID: 699337863a6c314849147d58.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### No Defense

Harmful Score: 3.63. Result ID: 699337863a6c314849147d52.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

### PPL

Harmful Score: 3.63. Result ID: 699337863a6c314849147d53.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608b7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71251e209131cea4f7d4.md>)

Recorded evaluation configuration: {"Model":"Vicuna"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
