Malicious activity detection on AgentDojo
92.7PrecisionADR
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ADR2026.05 | 92.7 | 100 | 96.2 | 38 | 3 | 5.5 | 0.012 | 18.5 | 0.029 | 47.3 | |
| ALRPHFS2026.05 | 91.4 | 84.2 | 87.7 | 32 | 3 | 5.5 | 0.004 | 13.6 | 0.011 | 17 | |
| LLM-as-judgeTests=6292026.06 | 89.7 | 99 | 94.1 | 297 | 34 | — | — | — | — | — | |
| VIGILTests=6292026.06 | 89.5 | 99.3 | 94.2 | 298 | 35 | — | — | — | — | — | |
| AgentSpecTests=6292026.06 | 87.6 | 96.7 | 91.9 | 290 | 41 | — | — | — | — | — | |
| ProgentTests=6292026.06 | 85.3 | 95 | 89.9 | 285 | 49 | — | — | — | — | — | |
| GuardAgent2026.05 | 77.1 | 71.1 | 74 | 27 | 8 | 14.5 | 0.01 | 10.1 | 0.033 | 13.9 | |
| LlamaFirewall2026.05 | 63.8 | 97.4 | 77.1 | 37 | 21 | 38.2 | 0.012 | 11.4 | 0.03 | 23 |