Video Jailbreak Defense on Video-SafetyBench Benign queries
0ASR (VC)RAI
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RAIModel=Qwen2.5-VL-7B2026.02 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| RAIModel=Qwen3-VL-8B2026.02 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| ShiftDCModel=Qwen3-VL-8B2026.02 | 1 | 0 | 4.22 | 4.2 | 4.51 | 0 | 0 | 0 | 0 | 9.8 | 3.55 | 10.25 | 4.5 | 3.23 | |
| RAIModel=LLaVA-OneVision-1.5-7B2026.02 | 1.33 | 2.1 | 1.25 | 0 | 0 | 0 | 0 | 0 | 2.45 | 1.1 | 0 | 0 | 0.4 | 0.66 | |
| AdashieldModel=Qwen3-VL-8B2026.02 | 2.56 | 2.71 | 4.26 | 1 | 8.4 | 0 | 2.25 | 1.08 | 0 | 10.42 | 3.24 | 14.33 | 5.63 | 4.3 | |
| ShiftDCModel=Qwen2.5-VL-7B2026.02 | 2.57 | 3.26 | 7.88 | 4.05 | 5.27 | 0 | 3.18 | 1.52 | 6.14 | 7.5 | 4.26 | 8.66 | 4.88 | 4.52 | |
| OriginalModel=Qwen3-VL-8B2026.02 | 3.12 | 4.16 | 6.66 | 1.66 | 13.54 | 0 | 5.2 | 3.12 | 6 | 12 | 5.2 | 23.33 | 7.5 | 7.04 | |
| ECSOModel=Qwen3-VL-8B2026.02 | 3.2 | 3.79 | 5.8 | 1.44 | 12.8 | 0 | 4.6 | 0 | 0 | 12.11 | 4 | 22 | 6.44 | 5.86 | |
| ShiftDCModel=LLaVA-OneVision-1.5-7B2026.02 | 4.58 | 6.6 | 10.22 | 6.88 | 7.15 | 0.2 | 5.4 | 2.53 | 8.6 | 10.5 | 6.2 | 12.4 | 6.7 | 6.76 | |
| AdashieldModel=Qwen2.5-VL-7B2026.02 | 8.46 | 9.14 | 28.57 | 15.45 | 18.6 | 0 | 12.2 | 5.5 | 20.4 | 24.5 | 15.8 | 26.44 | 13.53 | 15.27 | |
| AdashieldModel=LLaVA-OneVision-1.5-7B2026.02 | 15.6 | 14.23 | 38.5 | 25.4 | 28.96 | 1.5 | 18.5 | 10.2 | 30.5 | 35.6 | 22.4 | 36.8 | 23.15 | 23.18 | |
| ECSOModel=Qwen2.5-VL-7B2026.02 | 18.5 | 17.26 | 58.42 | 34.1 | 37.2 | 0 | 25.41 | 10.88 | 40.5 | 50.22 | 31.54 | 53.8 | 26.4 | 31.09 | |
| OriginalModel=Qwen2.5-VL-7B2026.02 | 19.79 | 18.75 | 61.66 | 36.66 | 39.58 | 0 | 27.08 | 11.45 | 43 | 53 | 33.33 | 56.67 | 28.75 | 33.05 | |
| ECSOModel=LLaVA-OneVision-1.5-7B2026.02 | 26.41 | 23.5 | 65.22 | 42.83 | 45.5 | 1.22 | 31.5 | 16.8 | 49.5 | 58.4 | 40.2 | 62.5 | 38.78 | 38.64 | |
| OriginalModel=LLaVA-OneVision-1.5-7B2026.02 | 28.57 | 25.66 | 68.44 | 45.29 | 48.5 | 0.21 | 33.43 | 18.2 | 52.15 | 62.5 | 42.8 | 65.6 | 41.19 | 40.96 |