Safety Evaluation on ATBench
78.4AccuracyAgentDoG 1.5-4B-U
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AgentDoG 1.5-4B-UBase Model=Qwen3.5 Base2026.05 | 78.4 | 79.8 | 75.7 | 77.7 | |
| Gemini-3-Flash2026.05 | 76.4 | 79.3 | 71 | 74.9 | |
| Gemini-3.1-Pro2026.05 | 75.5 | 76.1 | 73.8 | 75 | |
| GPT-5.42026.05 | 73.7 | 68.5 | 87.1 | 76.7 | |
| AgentDoG 1.5-4BBase Model=Qwen3.5 Base2026.05 | 72.4 | 69.2 | 80.3 | 74.3 | |
| AgentDoG 1.5-8BBase Model=Llama-3.1 Base2026.05 | 70.9 | 67.1 | 81.2 | 73.5 | |
| GPT-5.22026.05 | 69 | 65.6 | 79.3 | 71.8 | |
| AgentDoG 1.5-2BBase Model=Qwen3.5 Base2026.05 | 69 | 70.1 | 65.7 | 67.8 | |
| Qwen3.5-397B-A17B2026.05 | 66.8 | 65.5 | 70.2 | 67.8 | |
| AgentDoG 1.0-4BBase Model=Qwen3 Base2026.05 | 64 | 59.2 | 88.9 | 71.1 | |
| ShieldAgent2026.05 | 62.5 | 58 | 81.4 | 67.7 | |
| AgentDoG 1.5-0.8BBase Model=Qwen3.5 Base2026.05 | 60.3 | 58.6 | 68.6 | 63.2 | |
| Qwen3-235B-A22B-Instruct-25072026.05 | 59.2 | 58.2 | 63.8 | 60.8 | |
| Qwen3.5-2B2026.05 | 59.1 | 74.3 | 19.2 | 30.5 | |
| LlamaGuard4-12B2026.05 | 58.1 | 63.8 | 30.9 | 41.7 | |
| QwQ-32B2026.05 | 57.7 | 81.9 | 19.1 | 31 | |
| JoySafety2026.05 | 56.9 | 61.7 | 35 | 44.7 | |
| Qwen3-4B-Instruct-25072026.05 | 55.7 | 77.6 | 15.3 | 25.5 | |
| Qwen2.5-7B-Instruct2026.05 | 53.4 | 73.8 | 9.7 | 17.1 | |
| LlamaGuard3-8B2026.05 | 53.1 | 85.7 | 3.8 | 7.3 | |
| Qwen3-Guard2026.05 | 51.5 | 40 | 0.4 | 0.8 | |
| NemoGuard2026.05 | 49.9 | 49.5 | 41.6 | 45.2 | |
| Qwen3.5-0.8B2026.05 | 48.6 | 66.7 | 5.9 | 10.8 | |
| Qwen3.5-4B2026.05 | 45.9 | 41.2 | 20.7 | 27.6 | |
| Llama-3.1-8B-Instruct2026.05 | 45.3 | 47.3 | 89.5 | 61.9 |