# Agentic Prompt Injection Defense on AgentDojo (test)

Source: [Agentic Prompt Injection Defense on AgentDojo (test)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:24:01.534Z

Evaluation of model defense mechanisms against agentic prompt injection attacks using the test set of the AgentDojo dataset. Metrics focus on detailed Attack Success Rate (ASR) and Unauthorized Access (UA) across specific attack vectors, alongside Baseline Utility (BU).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Agentic Prompt Injection Defense |
| Dataset (including any stated split) | AgentDojo (test) |
| Metric | ASR (Direct) |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ASR (Direct)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=ASR%20(Direct)>): Lower is better; unit: PERCENT.

- [ASR (Ign. Prev.)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=ASR%20(Ign.%20Prev.)>): Lower is better; unit: PERCENT.

- [ASR (Sys. Msg.)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=ASR%20(Sys.%20Msg.)>): Lower is better; unit: PERCENT.

- [ASR (Imp. Msgs.)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=ASR%20(Imp.%20Msgs.)>): Lower is better; unit: PERCENT.

- [ASR (Avg Under Attack)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=ASR%20(Avg%20Under%20Attack)>): Lower is better; unit: PERCENT.

- [UA (Direct)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=UA%20(Direct)>): Lower is better; unit: PERCENT.

- [UA (Ign. Prev.)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=UA%20(Ign.%20Prev.)>): Lower is better; unit: PERCENT.

- [UA (Sys. Msg.)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=UA%20(Sys.%20Msg.)>): Lower is better; unit: PERCENT.

- [UA (Imp. Msgs.)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=UA%20(Imp.%20Msgs.)>): Lower is better; unit: PERCENT.

- [UA (Avg Under Attack)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=UA%20(Avg%20Under%20Attack)>): Lower is better; unit: PERCENT.

- [BU (No Attack)](<https://www.sota2.com/research/sota/agentic-prompt-injection-defense-on-agentdojo-test.md?metric=BU%20(No%20Attack)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ASR (Direct) | Result date | Report paper |
| --- | --- | --- | --- |
| MELON | 0 | Not recorded | 6937acf86cfd488761a4e6a2 |
| CCA | 0.42 | Not recorded | 6937acf86cfd488761a4e6a2 |
| DeBERTa | 0.74 | Not recorded | 6937acf86cfd488761a4e6a2 |
| Repeat Prompt | 0.95 | Not recorded | 6937acf86cfd488761a4e6a2 |
| No Defense | 2.32 | Not recorded | 6937acf86cfd488761a4e6a2 |
| Spotlight | 3.16 | Not recorded | 6937acf86cfd488761a4e6a2 |

### MELON

ASR (Direct): 0. Result ID: 69962d5d5698665ec46edf64.

[Reporting paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa795d1e209131cea7d4a3.md>)

Recorded evaluation configuration: {"Defensive Paradigm":"SOTA runtime verification"}. This record does not assert independent reproduction.

### CCA

ASR (Direct): 0.42. Result ID: 69962d5d5698665ec46edf65.

[Reporting paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

Recorded evaluation configuration: {"Full Name":"Cognitive Control Architecture"}. This record does not assert independent reproduction.

### DeBERTa

ASR (Direct): 0.74. Result ID: 69962d5d5698665ec46edf61.

[Reporting paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

Recorded evaluation configuration: {"Defensive Paradigm":"External model-based classifier"}. This record does not assert independent reproduction.

### Repeat Prompt

ASR (Direct): 0.95. Result ID: 69962d5d5698665ec46edf63.

[Reporting paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72a01e209131cea57a17.md>)

Recorded evaluation configuration: {"Defensive Paradigm":"Prompt engineering-based"}. This record does not assert independent reproduction.

### No Defense

ASR (Direct): 2.32. Result ID: 69962d5d5698665ec46edf60.

[Reporting paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Spotlight

ASR (Direct): 3.16. Result ID: 69962d5d5698665ec46edf62.

[Reporting paper](<https://www.sota2.com/research/paper/6937acf86cfd488761a4e6a2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72a01e209131cea57a17.md>)

Recorded evaluation configuration: {"Defensive Paradigm":"Prompt engineering-based"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
