Video Jailbreak Defense on Video-SafetyBench Harmful queries
01-VC ASRShiftDC
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ShiftDCModel=Qwen3-VL-8B2026.02 | 0 | 0 | 2.85 | 1.37 | 5.25 | 0 | 0 | 0 | 0 | 7.5 | 1.3 | 0.66 | 1 | 1.53 | |
| RAIModel=Qwen3-VL-8B2026.02 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| ECSOModel=Qwen3-VL-8B2026.02 | 0.78 | 0 | 4.44 | 1 | 18.55 | 0 | 0 | 0 | 0 | 15.66 | 1.04 | 1.5 | 1.23 | 3.4 | |
| AdashieldModel=Qwen3-VL-8B2026.02 | 1 | 0 | 5.55 | 1.22 | 18.6 | 0 | 0 | 0 | 0 | 11.45 | 1.66 | 1 | 1 | 3.19 | |
| RAIModel=Qwen2.5-VL-7B2026.02 | 1.04 | 4.29 | 5 | 0 | 0 | 0 | 2.08 | 0 | 7 | 2 | 2.08 | 1.67 | 1.25 | 2.03 | |
| OriginalModel=Qwen3-VL-8B2026.02 | 1.04 | 0 | 5 | 1.66 | 21.85 | 0 | 0 | 0 | 0 | 18 | 2.08 | 1.66 | 1.25 | 4.04 | |
| RAIModel=LLaVA-OneVision-1.5-7B2026.02 | 2.15 | 5.63 | 6.29 | 1.02 | 1.05 | 0 | 3.49 | 1.58 | 8.25 | 3.2 | 3.1 | 2.8 | 3.18 | 3.21 | |
| ShiftDCModel=Qwen2.5-VL-7B2026.02 | 5.28 | 10.52 | 6.8 | 4.22 | 4.5 | 0 | 8.43 | 3.26 | 14.5 | 9.8 | 8.55 | 10.27 | 4.52 | 6.97 | |
| ShiftDCModel=LLaVA-OneVision-1.5-7B2026.02 | 6.52 | 12.4 | 8.51 | 5.2 | 6.4 | 0.17 | 9.33 | 4.25 | 16.8 | 11.5 | 9.8 | 12.5 | 8.62 | 8.61 | |
| AdashieldModel=Qwen2.5-VL-7B2026.02 | 12.57 | 25.3 | 10.22 | 7.86 | 8.45 | 0 | 18.63 | 6.51 | 28.35 | 19.32 | 16.15 | 24.13 | 9.08 | 14.35 | |
| AdashieldModel=LLaVA-OneVision-1.5-7B2026.02 | 14.55 | 28.4 | 12.57 | 9.26 | 10.5 | 0.22 | 19.88 | 7.5 | 30.4 | 21.5 | 18.6 | 26.4 | 16.63 | 16.64 | |
| ECSOModel=Qwen2.5-VL-7B2026.02 | 22.11 | 40.55 | 17.82 | 12.43 | 12.84 | 0 | 30.15 | 11.8 | 52.43 | 35.5 | 31.23 | 42.81 | 17.5 | 25.16 | |
| ECSOModel=LLaVA-OneVision-1.5-7B2026.02 | 23.55 | 42.38 | 18.43 | 13.55 | 14.23 | 0.45 | 32.5 | 12.6 | 55.2 | 37.5 | 33.2 | 45.6 | 27.45 | 27.43 | |
| OriginalModel=Qwen2.5-VL-7B2026.02 | 23.95 | 42.7 | 18.33 | 13.53 | 13.54 | 0 | 32.29 | 12.5 | 55 | 37 | 33.33 | 45 | 18.75 | 26.6 | |
| OriginalModel=LLaVA-OneVision-1.5-7B2026.02 | 25.43 | 45.26 | 19.55 | 14.81 | 15.22 | 0.5 | 34.6 | 13.8 | 58.43 | 39.72 | 35.35 | 48.62 | 29.19 | 29.26 |