Prompt Injection Defense on AgentDojo New Attack 2
89.78Utility under Attack (UA)No Defense
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseBackbone Model=Gemini-3-Pro2026.02 | 89.78 | 1 | 8.85 | |
| Repeat PromptBackbone Model=Gemini-3-Pro2026.02 | 89.36 | 1.21 | 6.11 | |
| CausalArmorBackbone Model=Gemini-3-Pro2026.02 | 87.88 | 1.53 | 0 | |
| PromptArmorBackbone Model=Gemini-3-Pro2026.02 | 83.77 | 2.05 | 0.32 | |
| CausalArmorBackbone Model=Claude-4-Sonnet2026.02 | 83.03 | 1.7 | 0.46 | |
| No DefenseBackbone Model=Claude-4-Sonnet2026.02 | 81.77 | 1 | 18.97 | |
| PromptArmorBackbone Model=Claude-4-Sonnet2026.02 | 75.87 | 2.66 | 0 | |
| Repeat PromptBackbone Model=Claude-4-Sonnet2026.02 | 67.33 | 1.24 | 7.27 | |
| DRIFTBackbone Model=Gemini-3-Pro2026.02 | 66.68 | 6.53 | 4.24 | |
| DeBERTa DetectorBackbone Model=Gemini-3-Pro2026.02 | 56.8 | 1.06 | 6.11 | |
| DRIFTBackbone Model=Claude-4-Sonnet2026.02 | 55.53 | 7.59 | 2.48 | |
| DeBERTa DetectorBackbone Model=Claude-4-Sonnet2026.02 | 55.32 | 1.14 | 6.53 | |
| CausalArmorBackbone Model=Gemini-2.5-Flash2026.02 | 52.53 | 1.81 | 0.4 | |
| PromptArmorBackbone Model=Gemini-2.5-Flash2026.02 | 51.74 | 2.71 | 0.24 | |
| Repeat PromptBackbone Model=Gemini-2.5-Flash2026.02 | 51.53 | 1.14 | 7.38 | |
| No DefenseBackbone Model=Gemini-2.5-Flash2026.02 | 47.48 | 1 | 7.06 | |
| MelonBackbone Model=Claude-4-Sonnet2026.02 | 42.47 | 2.72 | 0 | |
| DRIFTBackbone Model=Gemini-2.5-Flash2026.02 | 42.44 | 5.25 | 1.25 | |
| MelonBackbone Model=Gemini-2.5-Flash2026.02 | 30.98 | 2.67 | 1.05 | |
| PiGuardBackbone Model=Gemini-3-Pro2026.02 | 29.92 | 1.07 | 0.84 | |
| DeBERTa DetectorBackbone Model=Gemini-2.5-Flash2026.02 | 28.35 | 1.24 | 4.11 | |
| PiGuardBackbone Model=Claude-4-Sonnet2026.02 | 27.92 | 1.2 | 0.42 | |
| PiGuardBackbone Model=Gemini-2.5-Flash2026.02 | 10.96 | 1.3 | 0 |