Response Harmfulness Classification on WildGuard (test)
79.48F1 (Total)GuardReasoner-VL 7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GuardReasoner-VL 7BModel Category=VLM Guard Model2026.02 | 79.48 | — | — | — | |
| Qwen3Guard Gen 8BModel Category=LLM Guard Model, Detection Mode=loose2026.02 | 78.83 | — | — | — | |
| GuardReasoner 8BModel Category=LLM Guard Model2026.02 | 78.2 | — | — | — | |
| Qwen3Guard Gen 8BModel Category=LLM Guard Model, Detection Mode=strict2026.02 | 78.06 | — | — | — | |
| PolyGuard-Qwen 7BModel Category=LLM Guard Model2026.02 | 77.89 | — | — | — | |
| GuardReasoner-Omni 4BModel Category=VLM Guard Model2026.02 | 77.57 | — | — | — | |
| GPT-42024.06 | 77.3 | 73.6 | 81.3 | — | |
| MD-Judge2024.06 | 76.8 | 67.7 | 85 | — | |
| MD-Judge 7BModel Category=LLM Guard Model2026.02 | 76.8 | — | — | — | |
| GuardReasoner-Omni 2BModel Category=VLM Guard Model2026.02 | 76.4 | — | — | — | |
| GuardReasoner-VL 3BModel Category=VLM Guard Model2026.02 | 76.12 | — | — | — | |
| WILDGUARD2024.06 | 75.4 | 68.4 | 81.5 | — | |
| WildGuard 7BModel Category=LLM Guard Model2026.02 | 75.4 | — | — | — | |
| LLaMA Guard 3 8BModel Category=LLM Guard Model2026.02 | 70.8 | — | — | — | |
| Llama-Guard22024.06 | 66.5 | 47.9 | 78.2 | — | |
| LLaMA Guard 4 12BModel Category=VLM Guard Model2026.02 | 66.39 | — | — | — | |
| BeaverDam2024.06 | 63.4 | 51.2 | 74.3 | — | |
| BeaverDam 7BModel Category=LLM Guard Model2026.02 | 63.4 | — | — | — | |
| LibrAI-LongFormer-harmbackbone=LongFormer2024.06 | 63.2 | 61.7 | 64.2 | — | |
| HarmB-Mistralbackbone=Mistral2024.06 | 60.1 | 51.8 | 70.3 | — | |
| HarmBench Mistral 7BModel Category=LLM Guard Model2026.02 | 60.1 | — | — | — | |
| Aegis-Guard-Ptype=Permissive2024.06 | 56.4 | 49 | 62.4 | — | |
| Aegis Guard Permissive 7BModel Category=LLM Guard Model2026.02 | 56.4 | — | — | — | |
| Llama-Guard2024.06 | 50.5 | 25.8 | 66.7 | — | |
| Aegis-Guard-Dtype=Defensive2024.06 | 49.1 | 40.4 | 57.6 | — | |
| Aegis Guard Defensive 7BModel Category=LLM Guard Model2026.02 | 49.1 | — | — | — | |
| ShieldGemma 9BModel Category=LLM Guard Model2026.02 | 47 | — | — | — | |
| HarmB-Llamabackbone=Llama2024.06 | 45.7 | 41.9 | 50.2 | — | |
| HarmBench LLaMA 13BModel Category=LLM Guard Model2026.02 | 45.7 | — | — | — | |
| OAI Mod. API2024.06 | 16.9 | 14.7 | 18.8 | — | |
| Aegis Guard 2.0Model Size=8B2026.05 | — | — | — | 77.5 | |
| Aegis Guard DefensiveModel Size=7B2026.05 | — | — | — | 49.1 | |
| Aegis Guard PermissiveModel Size=7B2026.05 | — | — | — | 56.4 | |
| BeaverDamModel Size=7B2026.05 | — | — | — | 63.4 | |
| COLAGUARDModel Size=3B2026.05 | — | — | — | 77.23 | |
| COLAGUARDModel Size=8B2026.05 | — | — | — | 81.23 | |
| GPT-4oModel Size=Unknown2026.05 | — | — | — | 65.24 | |
| GPT-4o+CoTModel Size=Unknown2026.05 | — | — | — | 71.43 | |
| GuardReasonerModel Size=1B2026.05 | — | — | — | 74.81 | |
| GuardReasonerModel Size=3B2026.05 | — | — | — | 79.7 | |
| GuardReasonerModel Size=8B2026.05 | — | — | — | 78.2 | |
| HarmBench LLaMAModel Size=13B2026.05 | — | — | — | 45.7 | |
| HarmBench MistralModel Size=7B2026.05 | — | — | — | 60.1 | |
| LLaMA GuardModel Size=7B2026.05 | — | — | — | 50.5 | |
| LLaMA Guard 2Model Size=8B2026.05 | — | — | — | 66.5 | |
| LLaMA Guard 3Model Size=8B2026.05 | — | — | — | 70.8 | |
| MD-JudgeModel Size=7B2026.05 | — | — | — | 76.8 | |
| o1-previewModel Size=Unknown2026.05 | — | — | — | 50 | |
| QwQ-previewModel Size=32B2026.05 | — | — | — | 17.56 | |
| ShieldGemmaModel Size=2B2026.05 | — | — | — | 20.13 | |
| ShieldGemmaModel Size=9B2026.05 | — | — | — | 47 | |
| WildGuardModel Size=7B2026.05 | — | — | — | 75.4 |