Safety Evaluation on XSTest en
0.8Over-Refusal RateSmolLM3 3B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SmolLM3 3BParameters=3B2026.03 | 0.8 | 51.5 | |
| Ministral-3-3BParameters=3B2026.03 | 1.2 | 71 | |
| Qwen3.5-4BParameters=4B2026.03 | 2.8 | 35.5 | |
| Gemma3-4BParameters=4B2026.03 | 3.6 | 44 | |
| Qwen3-4BParameters=4B2026.03 | 4 | 32.5 | |
| Tiny Aya Water2026.03 | 10 | 19.5 | |
| Tiny Aya Global2026.03 | 10.4 | 15.5 | |
| Tiny Aya Earth2026.03 | 10.4 | 19 | |
| Tiny Aya Fire2026.03 | 10.4 | 15 |