Tool-use LLM Agent Task Completion on AgentDojo Slack suite
95.24Benign Success RateRepeat User Prompt
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Repeat User PromptDefense Status=With Defense, Backbone=GPT-4o2026.06 | 95.24 | 61.9 | 80.95 | |
| DriftDefense Status=No Defense, Backbone=GPT-4o2026.06 | 95.24 | 47.62 | 57.14 | |
| Tool-GuardDefense Status=No Defense, Backbone=GPT-4o2026.06 | 95.24 | 52.38 | 80.95 | |
| System PromptDefense Status=No Defense, Backbone=GPT-4o2026.06 | 90.48 | 42.86 | 66.67 | |
| Repeat User PromptDefense Status=No Defense, Backbone=GPT-4o2026.06 | 90.48 | 28.57 | 76.19 | |
| ProagentDefense Status=No Defense, Backbone=GPT-4o2026.06 | 90.48 | 61.9 | 0 | |
| System PromptDefense Status=With Defense, Backbone=GPT-4o2026.06 | 85.71 | 61.9 | 47.62 | |
| Tool FilterDefense Status=No Defense, Backbone=GPT-4o2026.06 | 80.95 | 47.62 | 66.67 | |
| Tool-GuardDefense Status=With Defense, Backbone=GPT-4o2026.06 | 80.95 | 57.14 | 4.76 | |
| Tool FilterDefense Status=With Defense, Backbone=GPT-4o2026.06 | 76.19 | 52.38 | 23.81 | |
| DriftDefense Status=With Defense, Backbone=GPT-4o2026.06 | 66.67 | 47.62 | 66.67 | |
| ProagentDefense Status=With Defense, Backbone=GPT-4o2026.06 | 47.62 | 4.76 | 0 |