Multi-turn MLLM Safety Evaluation on STEER Average Multi-turn
64.89Safety ScoreSAFER-STEER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAFER-STEERBackbone=Qwen2.5VL-7B, Alignment Strategy=SAFER-STEER2026.03 | 64.89 | 72.35 | |
| SAFER-STEERBackbone=Qwen2.5VL-3B, Alignment Strategy=SAFER-STEER2026.03 | 55.58 | 70.27 | |
| SaFeR-VLMBackbone=Qwen2.5VL-7B, Alignment Strategy=SaFeR-VLM2026.03 | 55.19 | 63.75 | |
| SFTBackbone=Qwen2.5VL-7B, Alignment Strategy=SFT2026.03 | 50.31 | 66.86 | |
| SFTBackbone=Qwen2.5VL-3B, Alignment Strategy=SFT2026.03 | 41.61 | 57.57 | |
| SPA-VLBackbone=Qwen2.5VL-7B, Alignment Strategy=SPA-VL2026.03 | 37.28 | 52.52 | |
| TISBackbone=Qwen2.5VL-7B, Alignment Strategy=TIS2026.03 | 36.68 | 33.16 | |
| SaFeR-VLMBackbone=Qwen2.5VL-3B, Alignment Strategy=SaFeR-VLM2026.03 | 32.38 | 46.71 | |
| TISBackbone=Qwen2.5VL-3B, Alignment Strategy=TIS2026.03 | 26.94 | 27.03 | |
| MMDPOBackbone=Qwen2.5VL-7B, Alignment Strategy=MMDPO2026.03 | 26.47 | 51.21 | |
| Qwen2.5VL-7BBackbone=Qwen2.5VL-7B, Alignment Strategy=Base2026.03 | 24.66 | 46.48 | |
| SPA-VLBackbone=Qwen2.5VL-3B, Alignment Strategy=SPA-VL2026.03 | 23.81 | 36.68 | |
| GRLHF-VBackbone=Qwen2.5VL-7B, Alignment Strategy=GRLHF-V2026.03 | 19.53 | 38.96 | |
| SafeRLHF-VBackbone=Qwen2.5VL-7B, Alignment Strategy=SafeRLHF-V2026.03 | 17.7 | 24.86 | |
| MMDPOBackbone=Qwen2.5VL-3B, Alignment Strategy=MMDPO2026.03 | 13.1 | 27.16 | |
| GRLHF-VBackbone=Qwen2.5VL-3B, Alignment Strategy=GRLHF-V2026.03 | 12.93 | 28.41 | |
| Qwen2.5VL-3BBackbone=Qwen2.5VL-3B, Alignment Strategy=Base2026.03 | 12.55 | 27.13 | |
| SafeRLHF-VBackbone=Qwen2.5VL-3B, Alignment Strategy=SafeRLHF-V2026.03 | 8.58 | 13.04 |