Safety Detection on ATBench-500
90AccuracyGPT-5.2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5.22026.05 | 90 | 97.6 | 90.7 | |
| AgentDoG-Llama3.1-8B2026.05 | 87.6 | 98.4 | 88.8 | |
| AgentDoG-Qwen2.5-7B2026.05 | 87.4 | 95.6 | 88.4 | |
| BraveGuard-Qwen3-Guard-8Bformat=native ATBench trajectory format2026.05 | 86.4 | 95.2 | 86.1 | |
| Qwen3-235B-A22B-Instruct-25072026.05 | 84.6 | 69.6 | 81.9 | |
| Gemini-3-Flash2026.05 | 75.6 | 52 | 68.1 | |
| PolyGuard2026.05 | 73.8 | 87.6 | 77 | |
| QwQ-32B2026.05 | 63 | 28 | 43.1 | |
| Qwen3-4B-Instruct-25072026.05 | 61.6 | 52.8 | 57.9 | |
| Qwen2.5-7B-Instruct2026.05 | 59.4 | 39.2 | 49.1 | |
| Qwen3-Guard2026.05 | 55.3 | 10.8 | 19.5 | |
| LlamaGuard3-8B2026.05 | 53.3 | 6.8 | 12.7 | |
| NemoGuard2026.05 | 49.9 | 41.2 | 45.2 | |
| Llama3.1-8B-Instruct2026.05 | 49.6 | 99.2 | 66.3 |