Safety Evaluation on XSTest (ASR)
0.9ASRAMALIA-9B-DPO
Evaluation Results
| Method | Links | |
|---|---|---|
| AMALIA-9B-DPOModel category=Fully open models, Instruction-tuned=true, Post-training method=DPO, Judge model=Qwen3Guard-8B2026.03 | 0.9 | |
| Gemma 2-9BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 1.4 | |
| EuroLLM-9BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 1.9 | |
| AMALIA-9B-SFTModel category=Fully open models, Instruction-tuned=true, Post-training method=SFT, Judge model=Qwen3Guard-8B2026.03 | 1.9 | |
| Qwen 2.5-7BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 2.4 | |
| Llama 3.1-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 2.9 | |
| Gemma 3-12BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 3.4 | |
| Apertus-8BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 3.9 | |
| Gervasio-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 3.9 | |
| Qwen 3-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 4.4 | |
| Ministral-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 9.9 | |
| Mistral-7BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 13.4 | |
| OLMo 2-7BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 17.4 | |
| Salamandra-7BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 23.4 |