Response Harmfulness Detection on XSTEST-RESP
95.48Response Harmfulness F1GuardReasoner-Omni 4B
Evaluation results
| Method | Links | |
|---|---|---|
| GuardReasoner-Omni 4BModel Category=VLM Guard Model2026.02 | 95.48 | |
| GPT-4Specific Model=gpt-4-0125-preview2024.06 | 95.4 | |
| ConsisGuardCategory=Reasoning-based Guardrails, Model Size=7B2026.05 | 95.33 | |
| WILDGUARD2024.06 | 94.7 | |
| WildGuard 7BModel Category=LLM Guard Model2026.02 | 94.7 | |
| WildGuardModel Size=7B2026.05 | 94.7 | |
| WildGuardCategory=Discriminant-based Guardrails, Model Size=7B2026.05 | 94.7 | |
| GuardReasoner 8BModel Category=LLM Guard Model2026.02 | 94.34 | |
| GuardReasonerModel Size=8B2026.05 | 94.34 | |
| GuardReasonerCategory=Reasoning-based Guardrails, Model Size=8B2026.05 | 94.34 | |
| COLAGUARDModel Size=3B2026.05 | 94.19 | |
| Qwen3Guard Gen 8BModel Category=LLM Guard Model, Detection Mode=loose2026.02 | 93.67 | |
| WILDGUARD2024.06 | 93.4 | |
| GuardReasoner-Omni 2BModel Category=VLM Guard Model2026.02 | 92.9 | |
| GuardReasoner-VL 7BModel Category=VLM Guard Model2026.02 | 92.72 | |
| ConsisGuardCategory=Reasoning-based Guardrails, Model Size=3B2026.05 | 92.54 | |
| GuardReasoner-VL 3BModel Category=VLM Guard Model2026.02 | 92.5 | |
| Qwen3Guard Gen 8BModel Category=LLM Guard Model, Detection Mode=strict2026.02 | 92.12 | |
| COLAGUARDModel Size=8B2026.05 | 92.02 | |
| GPT-4+CoTCategory=CoT-Based LLM, Model Size=-2026.05 | 91.9 | |
| GuardReasonerModel Size=3B2026.05 | 91.36 | |
| GuardReasonerCategory=Reasoning-based Guardrails, Model Size=3B2026.05 | 91.36 | |
| GPT-4Specific Model=gpt-4-0125-preview2024.06 | 91.3 | |
| Llama-Guard22024.06 | 90.8 | |
| LLaMA Guard 2Model Size=8B2026.05 | 90.8 | |
| LLaMA Guard 2Category=Discriminant-based Guardrails, Model Size=8B2026.05 | 90.8 | |
| Gemini 1.5+CoTCategory=CoT-Based LLM, Model Size=-2026.05 | 90.66 | |
| MD-Judge 7BModel Category=LLM Guard Model2026.02 | 90.4 | |
| MD-JudgeModel Size=7B2026.05 | 90.4 | |
| MD-JudgeCategory=Discriminant-based Guardrails, Model Size=7B2026.05 | 90.4 | |
| GuardReasonerModel Size=1B2026.05 | 90.12 | |
| LLaMA Guard 4 12BModel Category=VLM Guard Model2026.02 | 89.8 | |
| LLaMA Guard 3 8BModel Category=LLM Guard Model2026.02 | 87.67 | |
| LLaMA Guard 3Model Size=8B2026.05 | 87.67 | |
| LLaMA Guard 3Category=Discriminant-based Guardrails, Model Size=8B2026.05 | 87.67 | |
| GPT-4o+CoTModel Size=Unknown2026.05 | 86.9 | |
| GPT-4o+CoTCategory=CoT-Based LLM, Model Size=-2026.05 | 86.62 | |
| Claude 3.5+CoTCategory=CoT-Based LLM, Model Size=-2026.05 | 86.55 | |
| Aegis Guard 2.0Model Size=8B2026.05 | 86.2 | |
| qwen3-CoTCategory=CoT-Based LRM, Model Size=32B2026.05 | 85.88 | |
| Llama-Guard22024.06 | 85 | |
| BeaverDam 7BModel Category=LLM Guard Model2026.02 | 83.6 | |
| BeaverDamModel Size=7B2026.05 | 83.6 | |
| Llama-Guard2024.06 | 82 | |
| LLaMA GuardModel Size=7B2026.05 | 82 | |
| Llama-Guard2024.06 | 81.2 | |
| LibrAI-LongFormer-refBase Model=LongFormer2024.06 | 80.5 | |
| o1-pre+CoTCategory=CoT-Based LRM, Model Size=-2026.05 | 75.65 | |
| o1-previewModel Size=Unknown2026.05 | 74.75 | |
| ShieldGemma 9BModel Category=LLM Guard Model2026.02 | 73.86 | |
| ShieldGemmaModel Size=9B2026.05 | 73.86 | |
| ShieldGemmaCategory=Discriminant-based Guardrails, Model Size=9B2026.05 | 73.86 | |
| QWQ+CoTCategory=CoT-Based LRM, Model Size=32B2026.05 | 73.36 | |
| HarmBench Mistral 7BModel Category=LLM Guard Model2026.02 | 72 | |
| HarmBench MistralModel Size=7B2026.05 | 72 | |
| OAI Mod. API2024.06 | 70.5 | |
| Keyword-based detector2024.06 | 70.2 | |
| ShieldGemmaModel Size=2B2026.05 | 65.55 | |
| ShieldGemmaCategory=Discriminant-based Guardrails, Model Size=2B2026.05 | 65.55 | |
| GPT-4oModel Size=Unknown2026.05 | 65.12 | |
| PolyGuard-Qwen 7BModel Category=LLM Guard Model2026.02 | 64.57 | |
| HarmBench LLaMA 13BModel Category=LLM Guard Model2026.02 | 64.5 | |
| HarmBench LLaMAModel Size=13B2026.05 | 64.5 | |
| Aegis-Guard-PPolicy=Permissive2024.06 | 60.4 | |
| Aegis Guard Permissive 7BModel Category=LLM Guard Model2026.02 | 60.4 | |
| Aegis Guard PermissiveModel Size=7B2026.05 | 60.4 | |
| Aegis Guard PerCategory=Discriminant-based Guardrails, Model Size=7B2026.05 | 60.4 | |
| Aegis-Guard-DPolicy=Defensive2024.06 | 52.8 | |
| Aegis Guard Defensive 7BModel Category=LLM Guard Model2026.02 | 52.8 | |
| Aegis Guard DefensiveModel Size=7B2026.05 | 52.8 | |
| Aegis Guard DefCategory=Discriminant-based Guardrails, Model Size=7B2026.05 | 52.8 | |
| Aegis-Guard-PPolicy=Permissive2024.06 | 49 | |
| OAI Mod. API2024.06 | 46.6 | |
| ModerationCategory=Discriminant-based Guardrails, Model Size=-2026.05 | 46.6 | |
| QwQ-previewModel Size=32B2026.05 | 45.95 | |
| Aegis-Guard-DPolicy=Defensive2024.06 | 36.9 |