AgentDojo
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AgentDojo vulnerable-agent profile stress test (six banking pairs)
0Attack Success Count (out of 6)
5
AgentDojo
97Banking RL
5
AgentDojo Dynamic Benchmark
77.32Utility
4
AgentDojo Banking and Slack suites
35.29BU (No Attack)
4
AgentDojo
0ASR
3
AgentDojo
0False Positive Rate (FPR)
3
AgentDojo (Full)
78.26BU (NOATTACK)
3
AgentDojo
51.39Banking Defense Rate
3
AgentDojo important_instructions attack family v1.1.2
2.38ASR (%)
2
AgentDojo (Authoritative)
59.3Safety Score
2
AgentDojo Out-of-Distribution (OOD)
0ADR
2
AgentDojo exact-effect admissions
306Field Records
1
AgentDojo (live task bank)
199STC
1
AGENTDOJO Overall
0# False Negatives
1
AGENTDOJO Shopping suite
0FN Count
1
AGENTDOJO Travel suite
0False Negatives Count
1
AGENTDOJO Workspace suite
0False Negatives (#FN)
1
AGENTDOJO Slack suite
0False Negatives (FN)
1
AGENTDOJO Banking suite
0False Negatives (FN)
1