Harmful-input detection on Safety Evaluation Suite (AEG, AEG2, HB-A, HB-V, OAI, SAL, SST, Toxic, WGT, WJB)
89.8AEG ScoreWildGuard
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| WildGuard2026.06 | 89.8 | 81.6 | 92.2 | 99.1 | 72.7 | 97 | 99.5 | 70.7 | 88.7 | 97.8 | 88 | |
| Robust Harmful Features detectorBackbone=Gemma-9B2026.06 | 88 | 80.7 | 93.1 | 98.5 | 68.9 | 94.1 | 99.5 | 55.5 | 80.1 | 83.7 | 81.6 | |
| Robust Harmful Features detectorBackbone=Gemma-2B2026.06 | 87.8 | 81 | 91.6 | 99.1 | 68.8 | 97.6 | 99 | 64.5 | 82 | 88.6 | 85.3 | |
| Robust Harmful Features detectorBackbone=Qwen-14B2026.06 | 87.5 | 81.4 | 92.9 | 99.4 | 65.2 | 98.6 | 100 | 60.8 | 80.2 | 88.4 | 84.7 | |
| Robust Harmful Features detectorBackbone=Qwen-7B2026.06 | 86.5 | 82.5 | 90.1 | 98.7 | 69.8 | 98.5 | 99.5 | 66.6 | 77.9 | 90.7 | 86 | |
| Robust Harmful Features detectorBackbone=Llama-2-7B2026.06 | 86.2 | 82.2 | 79.7 | 99 | 76.1 | 64.9 | 99 | 78.8 | 82 | 88 | 75.2 | |
| Robust Harmful Features detectorBackbone=Gemma-27B2026.06 | 85.4 | 77.3 | 92.5 | 98.5 | 64.8 | 96.6 | 97.1 | 43.7 | 81.2 | 85.4 | 79.8 | |
| Robust Harmful Features detectorBackbone=Llama-3-8B2026.06 | 82.4 | 83.9 | 89.1 | 97.4 | 76.3 | 96.4 | 99.5 | 80.4 | 82 | 94.3 | 88.8 | |
| VanillaBackbone=Llama-2-7B2026.06 | 77.8 | 76.9 | 83.2 | 98.1 | 68.6 | 58.1 | 95.9 | 54.3 | 80.1 | 88.5 | 66.4 | |
| Qwen3Guard2026.06 | 76 | 82.7 | 83.6 | 98.7 | 80.8 | 93.2 | 97.4 | 82.4 | 86.7 | 91.2 | 87.7 | |
| VanillaBackbone=Llama-3-8B2026.06 | 75.7 | 78.3 | 86.4 | 94.1 | 73.7 | 88.7 | 98 | 58.4 | 79.9 | 88.8 | 79.7 | |
| VanillaBackbone=Qwen-7B2026.06 | 74.1 | 74.1 | 56.5 | 89.6 | 54.3 | 43.7 | 88.5 | 40.4 | 61.4 | 48.3 | 50.6 | |
| VanillaBackbone=Qwen-14B2026.06 | 72.8 | 73.4 | 66.6 | 86.4 | 55.1 | 32.2 | 88.9 | 36.1 | 66.8 | 60.6 | 47 | |
| LlamaGuard32026.06 | 71.7 | 77.1 | 84.6 | 98.1 | 79 | 45.5 | 99.5 | 53.9 | 76.8 | 67.9 | 59.9 | |
| VanillaBackbone=Gemma-9B2026.06 | 69.2 | 72.5 | 77.1 | 97.2 | 51.6 | 39.3 | 94.9 | 42.9 | 72 | 57.4 | 51.4 | |
| VanillaBackbone=Gemma-27B2026.06 | 68.4 | 71 | 76.6 | 97.5 | 53.8 | 41.5 | 93.8 | 42.3 | 72.6 | 55.2 | 51.9 | |
| LlamaGuard42026.06 | 67.8 | 71.5 | 85.2 | 95.7 | 73.5 | 66.4 | 98.5 | 51.5 | 73.8 | 69.6 | 66.6 | |
| VanillaBackbone=Gemma-2B2026.06 | 66.8 | 71.4 | 73.7 | 97.8 | 57.3 | 27 | 91.4 | 48.3 | 69.8 | 51.5 | 47 |