Agentic Safety Moderation on AgentHazard
109ASRw/o guardrail
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| w/o guardrailGuardrail=None2026.05 | 109 | — | — | — | — | — | — | |
| Qwen3Guard-Gen-4BGuardrail=Qwen3Guard-Gen-4B2026.05 | 109 | 0 | 0.1208 | 0.3226 | 0.0127 | 0.0129 | 13.02 | |
| Llama-Guard-3-8BGuardrail=Llama-Guard-3-8B2026.05 | 109 | 0 | 0.1008 | 0.3264 | 0.0118 | 0.0124 | 3 | |
| AgentDoG 1.5-0.8BBase Model=Qwen3.5 Thinking Base, Size=0.8B2026.05 | 76 | -12.69 | 0.1892 | 0.4603 | 0.0148 | 0.0149 | 358.44 | |
| AgentDoG 1.5-4BBase Model=Qwen3.5 Thinking Base, Size=4B2026.05 | 70 | -15 | 0.296 | 0.7378 | 0.0207 | 0.0209 | 493.38 |