List your company

Harmful prompt detection on Combined Average

90.18F1 Score (Combined Average)MLPM
72.416877.028481.6486.2516Feb 22, 2025

Evaluation results

MethodLinks
MLPMBackbone=OLMo2-7B-Inst, Methodology=Latent-Based2025.0290.18
WildGuardMethodology=Guard Model2025.0288.93
MLPMBackbone=Llama-8B-Inst, Methodology=Latent-Based2025.0288.3
MLPMBackbone=Mistral-7B-Inst, Methodology=Latent-Based2025.0287.55
Abdelnabi et al.Backbone=OLMo2-7B-Inst, Methodology=Latent-Based2025.0287.35
Ayub & MajumdarBackbone=OLMo2-7B-Inst, Methodology=Latent-Based2025.0287.06
MLPMBackbone=Qwen3-8B-Inst, Methodology=Latent-Based2025.0285.95
GraniteGuardian-3-1-8BMethodology=Guard Model2025.0285.62
Abdelnabi et al.Backbone=Llama-8B-Inst, Methodology=Latent-Based2025.0284.51
Abdelnabi et al.Backbone=Qwen3-8B-Inst, Methodology=Latent-Based2025.0284.36
Abdelnabi et al.Backbone=Mistral-7B-Inst, Methodology=Latent-Based2025.0284.32
Ayub & MajumdarBackbone=Mistral-7B-Inst, Methodology=Latent-Based2025.0284.31
Ayub & MajumdarBackbone=Qwen3-8B-Inst, Methodology=Latent-Based2025.0282.69
Ayub & MajumdarBackbone=Llama-8B-Inst, Methodology=Latent-Based2025.0282.09
LlamaGuard3Methodology=Guard Model2025.0279.56
Aegis-Guard-DMethodology=Guard Model2025.0278.82
ShieldGemma-9BMethodology=Guard Model2025.0273.1