Prompt Injection Defense on AgentDojo New Attack 1
89.88Utility under AttackNo Defense
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseBackbone Model=Gemini-3-Pro2026.02 | 89.88 | 1 | 5.69 | |
| Repeat PromptBackbone Model=Gemini-3-Pro2026.02 | 89.44 | 1.17 | 4.11 | |
| CausalArmorBackbone Model=Gemini-3-Pro2026.02 | 88.09 | 1.43 | 0.11 | |
| No DefenseBackbone Model=Claude-4-Sonnet2026.02 | 85.77 | 1 | 3.37 | |
| CausalArmorBackbone Model=Claude-4-Sonnet2026.02 | 83.67 | 1.56 | 0.11 | |
| PromptArmorBackbone Model=Gemini-3-Pro2026.02 | 83.67 | 2.01 | 0.11 | |
| PromptArmorBackbone Model=Claude-4-Sonnet2026.02 | 74.29 | 2.4 | 0 | |
| DRIFTBackbone Model=Gemini-3-Pro2026.02 | 71.45 | 6.61 | 3.65 | |
| Repeat PromptBackbone Model=Claude-4-Sonnet2026.02 | 68.6 | 1.21 | 1.26 | |
| DRIFTBackbone Model=Claude-4-Sonnet2026.02 | 65.31 | 6.38 | 0.63 | |
| DeBERTa DetectorBackbone Model=Claude-4-Sonnet2026.02 | 62.8 | 1.11 | 1.79 | |
| DeBERTa DetectorBackbone Model=Gemini-3-Pro2026.02 | 56.31 | 1.05 | 3.37 | |
| CausalArmorBackbone Model=Gemini-2.5-Flash2026.02 | 54.64 | 1.78 | 0.42 | |
| No DefenseBackbone Model=Gemini-2.5-Flash2026.02 | 51.59 | 1 | 12.01 | |
| PromptArmorBackbone Model=Gemini-2.5-Flash2026.02 | 50.32 | 2.5 | 0 | |
| Repeat PromptBackbone Model=Gemini-2.5-Flash2026.02 | 50.01 | 1.15 | 8.51 | |
| MelonBackbone Model=Claude-4-Sonnet2026.02 | 41.84 | 2.48 | 0.21 | |
| DRIFTBackbone Model=Gemini-2.5-Flash2026.02 | 36.38 | 5.58 | 2.48 | |
| DeBERTa DetectorBackbone Model=Gemini-2.5-Flash2026.02 | 33.62 | 1.2 | 4.21 | |
| MelonBackbone Model=Gemini-2.5-Flash2026.02 | 28.72 | 3.12 | 0.21 | |
| PiGuardBackbone Model=Gemini-3-Pro2026.02 | 25.92 | 1.06 | 0.63 | |
| PiGuardBackbone Model=Claude-4-Sonnet2026.02 | 25.4 | 1.15 | 0 | |
| PiGuardBackbone Model=Gemini-2.5-Flash2026.02 | 8.43 | 1.29 | 0.42 |