AgentDojo
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AgentDojo
80TCR @ ∞
16
AgentDojo
97.1Safety Rate
14
AgentDojo full latest
0.562ASR
14
AgentDojo Weighted Average (Overall)
85.57Benign Success Rate
12
AgentDojo Workspace suite
87.5Benign Success Rate
12
AgentDojo Travel suite
75Benign Success
12
AgentDojo Slack suite
95.24Benign Success Rate
12
AgentDojo Banking suite
93.75Benign Success Rate
12
AgentDojo Overall (test)
11.6ASR
12
AgentDojo Slack (test)
13.9ASR
12
AgentDojo Travel (test)
1.3ASR
12
AgentDojo Banking (test)
63.8ASR
12
AgentDojo Workspace (test)
2.1ASR
12
AgentDojo
69.15Utility under Attack
12
AgentDojo
64.36Benign Utility
12
AgentDojo Overall
84.54Clean Utility
12
AgentDojo Slack
80.95Clean Utility
12
AgentDojo Workspace
85Clean Utility
12
AgentDojo held-out
46.8ASR
10
AgentDojo Indirect Injection (test)
90Utility (No Attack)
9
AgentDojo
76.3Benign Utility
9
AgentDojo Slack suite
14.4Baseline ASR
9
AgentDojo
48Source Recall
8
AgentDojo
92.7Precision
8
AgentDojo without attack
0.49Total Tokens (M)
8