Multi-turn MLLM Safety Evaluation on STEER-MMSafe Multi-turn
77.04Safety ScoreSAFER-STEER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAFER-STEERBackbone=Qwen2.5VL-7B, Alignment Strategy=SAFER-STEER2026.03 | 77.04 | 86.87 | |
| SAFER-STEERBackbone=Qwen2.5VL-3B, Alignment Strategy=SAFER-STEER2026.03 | 69.03 | 85.98 | |
| SaFeR-VLMBackbone=Qwen2.5VL-7B, Alignment Strategy=SaFeR-VLM2026.03 | 58.96 | 78.18 | |
| SFTBackbone=Qwen2.5VL-7B, Alignment Strategy=SFT2026.03 | 57.83 | 80.51 | |
| SFTBackbone=Qwen2.5VL-3B, Alignment Strategy=SFT2026.03 | 50.43 | 72.9 | |
| TISBackbone=Qwen2.5VL-7B, Alignment Strategy=TIS2026.03 | 48.95 | 53.51 | |
| TISBackbone=Qwen2.5VL-3B, Alignment Strategy=TIS2026.03 | 33.24 | 38.71 | |
| SaFeR-VLMBackbone=Qwen2.5VL-3B, Alignment Strategy=SaFeR-VLM2026.03 | 32.23 | 55.92 | |
| SPA-VLBackbone=Qwen2.5VL-7B, Alignment Strategy=SPA-VL2026.03 | 28.92 | 45.05 | |
| SPA-VLBackbone=Qwen2.5VL-3B, Alignment Strategy=SPA-VL2026.03 | 23.63 | 40.32 | |
| MMDPOBackbone=Qwen2.5VL-7B, Alignment Strategy=MMDPO2026.03 | 14.74 | 34.4 | |
| SafeRLHF-VBackbone=Qwen2.5VL-7B, Alignment Strategy=SafeRLHF-V2026.03 | 11.99 | 22.11 | |
| Qwen2.5VL-7BBackbone=Qwen2.5VL-7B, Alignment Strategy=Base2026.03 | 11.42 | 30.42 | |
| GRLHF-VBackbone=Qwen2.5VL-7B, Alignment Strategy=GRLHF-V2026.03 | 9.97 | 24.57 | |
| MMDPOBackbone=Qwen2.5VL-3B, Alignment Strategy=MMDPO2026.03 | 7.37 | 18.42 | |
| GRLHF-VBackbone=Qwen2.5VL-3B, Alignment Strategy=GRLHF-V2026.03 | 7.15 | 20.95 | |
| Qwen2.5VL-3BBackbone=Qwen2.5VL-3B, Alignment Strategy=Base2026.03 | 4.92 | 15.91 | |
| SafeRLHF-VBackbone=Qwen2.5VL-3B, Alignment Strategy=SafeRLHF-V2026.03 | 4.05 | 7.81 |