Safety and Helpfulness Evaluation on VLSBench
84.41Safety ScoreSAFER-STEER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAFER-STEERBase Model=Qwen2.5VL-7B, Method Category=Dynamic Methods2026.03 | 84.41 | 65.74 | |
| TISBase Model=Qwen2.5VL-7B, Method Category=Static Methods2026.03 | 82.11 | 68.27 | |
| SAFER-STEERBase Model=Qwen2.5VL-3B, Method Category=Dynamic Methods2026.03 | 76.2 | 54.05 | |
| SFTBase Model=Qwen2.5VL-7B, Method Category=Dynamic Methods2026.03 | 76.07 | 55.04 | |
| SFTBase Model=Qwen2.5VL-3B, Method Category=Dynamic Methods2026.03 | 72.99 | 48.27 | |
| SaFeR-VLMBase Model=Qwen2.5VL-7B, Method Category=Static Methods2026.03 | 72.54 | 61.92 | |
| SPA-VLBase Model=Qwen2.5VL-7B, Method Category=Static Methods2026.03 | 69.89 | 55.8 | |
| TISBase Model=Qwen2.5VL-3B, Method Category=Static Methods2026.03 | 67.31 | 47.39 | |
| SaFeR-VLMBase Model=Qwen2.5VL-3B, Method Category=Static Methods2026.03 | 65.15 | 54.26 | |
| Qwen2.5VL-7BBase Model=Qwen2.5VL-7B, Method Category=Base2026.03 | 62.86 | 59.31 | |
| SPA-VLBase Model=Qwen2.5VL-3B, Method Category=Static Methods2026.03 | 61.25 | 44.07 | |
| MMDPOBase Model=Qwen2.5VL-7B, Method Category=Static Methods2026.03 | 57.6 | 52.83 | |
| GRLHF-VBase Model=Qwen2.5VL-7B, Method Category=Static Methods2026.03 | 57.3 | 54.95 | |
| Qwen2.5VL-3BBase Model=Qwen2.5VL-3B, Method Category=Base2026.03 | 55.22 | 52.66 | |
| MMDPOBase Model=Qwen2.5VL-3B, Method Category=Static Methods2026.03 | 52.59 | 48.53 | |
| GRLHF-VBase Model=Qwen2.5VL-3B, Method Category=Static Methods2026.03 | 50.33 | 51.9 | |
| SafeRLHF-VBase Model=Qwen2.5VL-7B, Method Category=Static Methods2026.03 | 46.36 | 32.38 | |
| SafeRLHF-VBase Model=Qwen2.5VL-3B, Method Category=Static Methods2026.03 | 38.41 | 23.21 |