# Indirect Prompt Injection Sanitization on IPI Sanitization Total

Source: [Indirect Prompt Injection Sanitization on IPI Sanitization Total](<https://www.sota2.com/research/sota/indirect-prompt-injection-sanitization-on-ipi-sanitization-total>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:35:06.573Z

Evaluation of model performance on Indirect Prompt Injection Sanitization using the IPI Sanitization Total dataset, measured by Attack Success Rate (ASR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Indirect Prompt Injection Sanitization |
| Dataset (including any stated split) | IPI Sanitization Total |
| Metric | Attack Success Rate (ASR) |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Attack Success Rate (ASR)](<https://www.sota2.com/research/sota/indirect-prompt-injection-sanitization-on-ipi-sanitization-total.md?metric=Attack%20Success%20Rate%20(ASR)>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Attack Success Rate (ASR) | Result date | Report paper |
| --- | --- | --- | --- |
| RENNERVATE | 0.2 | Not recorded | 6938fe806cfd488761a53c13 |
| RENNERVATE | 0.2 | Not recorded | 6938fe806cfd488761a53c13 |
| StruQ | 0.3 | Not recorded | 6938fe806cfd488761a53c13 |
| GPT-Loc | 9.3 | Not recorded | 6938fe806cfd488761a53c13 |
| GPT-Loc | 9.7 | Not recorded | 6938fe806cfd488761a53c13 |
| DeepSeek-Loc | 17.7 | Not recorded | 6938fe806cfd488761a53c13 |
| DeepSeek-Loc | 20.4 | Not recorded | 6938fe806cfd488761a53c13 |
| Sandwich | 29.1 | Not recorded | 6938fe806cfd488761a53c13 |
| Instructional | 30.7 | Not recorded | 6938fe806cfd488761a53c13 |
| Sandwich | 33.7 | Not recorded | 6938fe806cfd488761a53c13 |
| Instructional | 47.9 | Not recorded | 6938fe806cfd488761a53c13 |
| Spotlighting | 49.7 | Not recorded | 6938fe806cfd488761a53c13 |
| Spotlighting | 51.3 | Not recorded | 6938fe806cfd488761a53c13 |
| None | 60.8 | Not recorded | 6938fe806cfd488761a53c13 |
| None | 67.1 | Not recorded | 6938fe806cfd488761a53c13 |

### RENNERVATE

Attack Success Rate (ASR): 0.2. Result ID: 699705b25698665ec452dab3.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### RENNERVATE

Attack Success Rate (ASR): 0.2. Result ID: 699705b25698665ec452daba.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### StruQ

Attack Success Rate (ASR): 0.3. Result ID: 699705b25698665ec452dab2.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65117.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### GPT-Loc

Attack Success Rate (ASR): 9.3. Result ID: 699705b25698665ec452dab9.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa680c1e209131cea19d53.md>)

[Implementation](<https://github.com/openai/gpt-3/blob/master/overlap_frequency.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### GPT-Loc

Attack Success Rate (ASR): 9.7. Result ID: 699705b25698665ec452dab1.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa680c1e209131cea19d53.md>)

[Implementation](<https://github.com/openai/gpt-3/blob/master/overlap_frequency.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### DeepSeek-Loc

Attack Success Rate (ASR): 17.7. Result ID: 699705b25698665ec452dab8.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73b81e209131cea5e189.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### DeepSeek-Loc

Attack Success Rate (ASR): 20.4. Result ID: 699705b25698665ec452dab0.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73b81e209131cea5e189.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### Sandwich

Attack Success Rate (ASR): 29.1. Result ID: 699705b25698665ec452dab5.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### Instructional

Attack Success Rate (ASR): 30.7. Result ID: 699705b25698665ec452dab7.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### Sandwich

Attack Success Rate (ASR): 33.7. Result ID: 699705b25698665ec452daad.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### Instructional

Attack Success Rate (ASR): 47.9. Result ID: 699705b25698665ec452daaf.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### Spotlighting

Attack Success Rate (ASR): 49.7. Result ID: 699705b25698665ec452daae.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72a01e209131cea57a17.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

### Spotlighting

Attack Success Rate (ASR): 51.3. Result ID: 699705b25698665ec452dab6.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72a01e209131cea57a17.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### None

Attack Success Rate (ASR): 60.8. Result ID: 699705b25698665ec452dab4.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA3"}. This record does not assert independent reproduction.

### None

Attack Success Rate (ASR): 67.1. Result ID: 699705b25698665ec452daac.

[Reporting paper](<https://www.sota2.com/research/paper/6938fe806cfd488761a53c13.md>)

Recorded evaluation configuration: {"Target LLM":"LLaMA2"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
