Agent Safety on AgentHarm
4PAIR ASRTrustAgent
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TrustAgentGuardrail Category=Prompt-level guardrails2026.06 | 4 | 85.2 | 25.6 | 5.7 | 85.2 | 25.5 | 4.5 | 72.7 | 42.4 | 7.4 | 81.8 | 30.4 | 0 | 80.7 | 32.4 | 14.8 | 73.3 | 40.7 | |
| GuardAgentGuardrail Category=Memory-augmented guardrails2026.06 | 10.8 | 52.3 | 62.2 | 35.8 | 52.3 | 54.8 | 8.5 | 52.3 | 62.7 | 31.3 | 52.8 | 55.9 | 19.3 | 53.4 | 59.1 | 24.4 | 52.8 | 58.1 | |
| ShieldAgentGuardrail Category=Prompt-level guardrails2026.06 | 11.4 | 52.8 | 61.6 | 30.1 | 54 | 55.5 | 11.9 | 53.4 | 60.9 | 34.7 | 51.7 | 55.5 | 22.7 | 52.8 | 58.6 | 17.6 | 53.4 | 59.5 | |
| MEMBRANEGuardrail Category=Memory-augmented guardrails2026.06 | 44.3 | 7.4 | 69.5 | 53.2 | 14 | 60.5 | 26.3 | 8.9 | 81.5 | 11.9 | 9.7 | 89.2 | 0.9 | 12.3 | 93 | 42.8 | 8 | 70.5 | |
| AGrailGuardrail Category=Memory-augmented guardrails2026.06 | 50 | 31.3 | 57.9 | 55.7 | 29 | 54.6 | 39.8 | 27.8 | 65.7 | 34.1 | 31.8 | 67 | 26.7 | 32.4 | 70.3 | 47.2 | 30.7 | 60 | |
| VanillaGuardrail Category=Unguarded2026.06 | 98.9 | 0 | 2.2 | 96 | 0 | 7.7 | 97.7 | 0 | 4.4 | 99.4 | 0 | 1.1 | 100 | 0 | 0 | 98.9 | 0 | 2.2 |