Safety Evaluation on SST (ASR)
20.4ASROLMo 2-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| OLMo 2-7BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 20.4 | |
| Mistral-7BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 19.4 | |
| Salamandra-7BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 18.4 | |
| Gervasio-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 9.4 | |
| Ministral-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 8.4 | |
| Llama 3.1-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 7.4 | |
| Apertus-8BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 4.4 | |
| Qwen 3-8BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 4.4 | |
| EuroLLM-9BModel category=Fully open models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 3.4 | |
| AMALIA-9B-SFTModel category=Fully open models, Instruction-tuned=true, Post-training method=SFT, Judge model=Qwen3Guard-8B2026.03 | 3.4 | |
| Qwen 2.5-7BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 3.4 | |
| Gemma 3-12BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 2.4 | |
| AMALIA-9B-DPOModel category=Fully open models, Instruction-tuned=true, Post-training method=DPO, Judge model=Qwen3Guard-8B2026.03 | 1.4 | |
| Gemma 2-9BModel category=Open weight models, Instruction-tuned=true, Judge model=Qwen3Guard-8B2026.03 | 0.4 |