Refusal Evaluation on Harmful prompt suite (test)
95.5Refusal RateBase
Evaluation results
| Method | Links | |
|---|---|---|
| BaseModel=Ministral-3B-Instruct-25122026.01 | 95.5 | |
| BaseModel=Qwen3-VL-8B-Instruct2026.01 | 93.8 | |
| BaseModel=Ministral-14B-Instruct-25122026.01 | 91.9 | |
| BaseModel=Qwen3-VL-4B-Instruct2026.01 | 84 | |
| BaseModel=Qwen3-VL-2B-Instruct2026.01 | 83.3 | |
| StandardModel=Qwen3-VL-8B-Instruct2026.01 | 42 | |
| StandardModel=Ministral-14B-Instruct-25122026.01 | 12 | |
| SRAModel=Qwen3-VL-8B-Instruct2026.01 | 2 | |
| SRAModel=Ministral-3B-Instruct-25122026.01 | 2 | |
| StandardModel=Qwen3-VL-2B-Instruct2026.01 | 0 | |
| SRAModel=Qwen3-VL-2B-Instruct2026.01 | 0 | |
| StandardModel=Qwen3-VL-4B-Instruct2026.01 | 0 | |
| SRAModel=Qwen3-VL-4B-Instruct2026.01 | 0 | |
| StandardModel=Ministral-3B-Instruct-25122026.01 | 0 | |
| SRAModel=Ministral-14B-Instruct-25122026.01 | 0 |