Multimodal Safety Evaluation on BeaverTails-V benchmark leaderboard · SOTA2 Research

Multimodal Safety Evaluation on BeaverTails-V

2.9Safety ScoreQwen2.5-VL-7B + TIS

Evaluation Results

Method	Links
Qwen2.5-VL-7B + TIS2026.03		2.9	2.77	2.88
Qwen2.5-VL-3B + SFT+GRPO2026.03		2.85	2.75	2.89
Qwen2.5-VL-3B + SFT+DPO+GRPO2026.03		2.84	2.78	2.87
Qwen2.5-VL-7B + SFT+GRPO2026.03		2.84	2.84	2.91
Qwen2.5-VL-7B + SaFeR-VLM2026.03		2.83	2.33	2.54
Qwen2.5-VL-7B + SPA-VL2026.03		2.82	2.6	2.27
Qwen2.5-VL-7B + SFT+DPO+GRPO2026.03		2.82	2.88	2.93
Qwen2.5-VL-3B + TIS2026.03		2.75	2.37	2.69
Qwen2.5-VL-3B + SPA-VL2026.03		2.74	2.59	2.23
Qwen2.5-VL-3B + SaFeR-VLM2026.03		2.72	2.27	2.28
Qwen2.5-VL-7B + SFT+DPO2026.03		2.72	2.81	2.91
Qwen2.5-VL-7B + VLGuard2026.03		2.64	1.73	1.9
Qwen2.5-VL-7B + SFT2026.03		2.62	2.66	2.86
Qwen2.5-VL-3B + VLGuard2026.03		2.61	1.69	1.86
Qwen2.5-VL-3B + SFT+DPO2026.03		2.58	2.66	2.77
Qwen2.5-VL-3B + SFT2026.03		2.57	2.61	2.77
Qwen2.5-VL-7B + SIA2026.03		2.5	2.33	2.17
Qwen2.5-VL-7B2026.03		1.67	2.7	2.14
Qwen2.5-VL-7B + ECSO2026.03		1.58	2.67	2.15
Qwen2.5-VL-3B + SIA2026.03		0.82	2.01	1.39
Qwen2.5-VL-3B + ECSO2026.03		0.73	2.41	1.66
Qwen2.5-VL-3B2026.03		0.59	2.56	1.68