Safety Evaluation on MMBench
99.7DSRVLGuard
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VLGuardArch.=Qwen2.5 VL 7B2025.05 | 99.7 | 1.3 | |
| SPA-VLArch.=Qwen2.5 VL 7B2025.05 | 99.2 | 3.1 | |
| VideoSafety-R1Arch.=Qwen2.5VL-7B2025.05 | 98 | 3.9 | |
| VideoSafety-R1Arch.=VideoLLaMA-2B2025.05 | 89.2 | 4 | |
| VideoSafety-R1Arch.=Qwen2.5VL-3B2025.05 | 80.6 | 4.7 | |
| MM-RLHFArch.=Qwen2.5 VL 7B2025.05 | 80.2 | 4.5 | |
| Self-ReminderArch.=Qwen2.5 VL-7B2025.05 | 47 | 4.3 | |
| VideoLLaMA3Arch.=VideoLLaMA3-7B2025.05 | 39.9 | 4.2 | |
| Qwen2.5 VLArch.=Qwen2.5 VL-7B2025.05 | 34.2 | 4.5 | |
| Qwen2.5 VLArch.=Qwen2.5 VL-3B2025.05 | 31.2 | 4.8 | |
| VideoLLaMA3Arch.=VideoLLaMA3-2B2025.05 | 30.1 | 4.2 |