Safety Evaluation on FigStep
100DSRVLGuard
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VLGuardArch.=Qwen2.5 VL 7B2025.05 | 100 | 1.1 | |
| SPA-VLArch.=Qwen2.5 VL 7B2025.05 | 98.8 | 2.8 | |
| VideoSafety-R1Arch.=Qwen2.5VL-7B2025.05 | 87 | 4.2 | |
| VideoSafety-R1Arch.=VideoLLaMA-2B2025.05 | 80.2 | 3.9 | |
| MM-RLHFArch.=Qwen2.5 VL 7B2025.05 | 71.7 | 4.9 | |
| VideoSafety-R1Arch.=Qwen2.5VL-3B2025.05 | 69.1 | 5 | |
| VideoLLaMA3Arch.=VideoLLaMA3-2B2025.05 | 65.2 | 3.3 | |
| Self-ReminderArch.=Qwen2.5 VL-7B2025.05 | 63.4 | 4.1 | |
| VideoLLaMA3Arch.=VideoLLaMA3-7B2025.05 | 46.4 | 3.3 | |
| Qwen2.5 VLArch.=Qwen2.5 VL-7B2025.05 | 23.8 | 4.9 | |
| Qwen2.5 VLArch.=Qwen2.5 VL-3B2025.05 | 22.2 | 4.7 |