Adversarial Attacks Detection on Agentic Workflow Aggregate (test)
100PrecisionQwen3Guard-8B-loose
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3Guard-8B-looseReasoning=Without2025.12 | 100 | 33 | 50 | 0 | |
| Qwen3Guard-8B-strictReasoning=Without2025.12 | 99 | 41 | 58 | 0 | |
| gpt-oss-safeguard-20BReasoning=With2025.12 | 99 | 44 | 61 | 1 | |
| Llama-guard-3-8BReasoning=Without2025.12 | 94 | 37 | 53 | 4 | |
| Llama-guard-4-12BReasoning=Without2025.12 | 94 | 48 | 63 | 6 | |
| AprielGuard-8BReasoning=Without2025.12 | 94 | 92 | 93 | 11 | |
| AprielGuard-8BReasoning=With2025.12 | 94 | 91 | 92 | 11 | |
| IBM-Granite-Guardian-3.3-8BReasoning=Without2025.12 | 93 | 81 | 87 | 12 | |
| Llama-guard-2-8BReasoning=Without2025.12 | 92 | 23 | 37 | 4 | |
| IBM-Granite-Guardian-3.3-8BReasoning=With2025.12 | 92 | 69 | 79 | 12 | |
| IBM-Granite-Guardian-3.2-5BReasoning=Without2025.12 | 91 | 81 | 86 | 16 | |
| Llama-Prompt-Guard-2-86MReasoning=Without2025.12 | 90 | 77 | 83 | 17 | |
| IBM-Granite-Guardian-3.2-3BReasoning=Without2025.12 | 90 | 76 | 82 | 16 | |
| ShieldGemma-9BReasoning=Without2025.12 | 89 | 24 | 38 | 6 | |
| IBM-Granite-Guardian-3.1-2BReasoning=Without2025.12 | 88 | 87 | 88 | 23 |