Prompt Injection Defense on AgentDojo Important Instructions
0.9041Utility under AttackNo Defense
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseBackbone Model=Gemini-3-Pro2026.02 | 0.9041 | 1 | 0.0506 | |
| Repeat PromptBackbone Model=Gemini-3-Pro2026.02 | 0.8999 | 1.18 | 0.0285 | |
| CausalArmorBackbone Model=Gemini-3-Pro2026.02 | 0.8714 | 1.44 | 0.0011 | |
| No DefenseBackbone Model=Claude-4-Sonnet2026.02 | 0.8398 | 1 | 0.0232 | |
| CausalArmorBackbone Model=Claude-4-Sonnet2026.02 | 0.8367 | 1.54 | 0 | |
| PromptArmorBackbone Model=Gemini-3-Pro2026.02 | 0.8335 | 1.98 | 0.0011 | |
| PromptArmorBackbone Model=Claude-4-Sonnet2026.02 | 0.7408 | 2.44 | 0 | |
| DRIFTBackbone Model=Gemini-3-Pro2026.02 | 0.7065 | 6.44 | 0.0385 | |
| Repeat PromptBackbone Model=Claude-4-Sonnet2026.02 | 0.6902 | 1.18 | 0.0084 | |
| DRIFTBackbone Model=Claude-4-Sonnet2026.02 | 0.6692 | 6.63 | 0.0082 | |
| DeBERTa DetectorBackbone Model=Gemini-3-Pro2026.02 | 0.5543 | 2.06 | 0.0105 | |
| CausalArmorBackbone Model=Gemini-2.5-Flash2026.02 | 0.509 | 1.96 | 0.0062 | |
| DeBERTa DetectorBackbone Model=Claude-4-Sonnet2026.02 | 0.4963 | 1.12 | 0.0137 | |
| PromptArmorBackbone Model=Gemini-2.5-Flash2026.02 | 0.4182 | 2.65 | 0.0063 | |
| Repeat PromptBackbone Model=Gemini-2.5-Flash2026.02 | 0.4141 | 1.15 | 0.3593 | |
| MelonBackbone Model=Claude-4-Sonnet2026.02 | 0.4141 | 2.41 | 0.0021 | |
| No DefenseBackbone Model=Gemini-2.5-Flash2026.02 | 0.3246 | 1 | 0.3247 | |
| PiGuardBackbone Model=Claude-4-Sonnet2026.02 | 0.313 | 1.16 | 0.0063 | |
| PiGuardBackbone Model=Gemini-3-Pro2026.02 | 0.3119 | 1.06 | 0.0063 | |
| DRIFTBackbone Model=Gemini-2.5-Flash2026.02 | 0.1687 | 6.75 | 0.0499 | |
| DeBERTa DetectorBackbone Model=Gemini-2.5-Flash2026.02 | 0.1675 | 1.24 | 0.0727 | |
| MelonBackbone Model=Gemini-2.5-Flash2026.02 | 0.138 | 2.83 | 0.0053 | |
| PiGuardBackbone Model=Gemini-2.5-Flash2026.02 | 0.0801 | 1.28 | 0.0105 |