Safety Evaluation on MCV SafetyBench (four-clip setting)
0.62ASRImage filtering
Evaluation Results
| Method | Links | |
|---|---|---|
| Image filteringModel=Qwen3-VL-8B, Attack Type=Implicit, Number of clips=42026.06 | 0.62 | |
| Image filteringModel=LLaVA-Video-7B, Attack Type=Implicit, Number of clips=42026.06 | 5.55 | |
| AdashieldModel=LLaVA-Video-7B, Attack Type=Implicit, Number of clips=42026.06 | 5.62 | |
| AdashieldModel=Qwen3-VL-8B, Attack Type=Implicit, Number of clips=42026.06 | 15.68 | |
| Image filteringModel=Average, Attack Type=Implicit, Number of clips=42026.06 | 17.37 | |
| AdashieldModel=InternVL3.5-8B, Attack Type=Implicit, Number of clips=42026.06 | 23.01 | |
| AdashieldModel=Average, Attack Type=Implicit, Number of clips=42026.06 | 29.45 | |
| Image filteringModel=InternVL3.5-8B, Attack Type=Implicit, Number of clips=42026.06 | 29.66 | |
| Safe systemModel=InternVL3.5-8B, Attack Type=Implicit, Number of clips=42026.06 | 33.01 | |
| Image filteringModel=Qwen2.5-VL-7B, Attack Type=Implicit, Number of clips=42026.06 | 33.63 | |
| Safe systemModel=LLaVA-Video-7B, Attack Type=Implicit, Number of clips=42026.06 | 50.62 | |
| OriginalModel=LLaVA-Video-7B, Attack Type=Implicit, Number of clips=42026.06 | 50.68 | |
| Safe systemModel=Average, Attack Type=Implicit, Number of clips=42026.06 | 52.79 | |
| Safe systemModel=Qwen3-VL-8B, Attack Type=Implicit, Number of clips=42026.06 | 57.05 | |
| OriginalModel=InternVL3.5-8B, Attack Type=Implicit, Number of clips=42026.06 | 65.27 | |
| OriginalModel=Average, Attack Type=Implicit, Number of clips=42026.06 | 67.34 | |
| Safe systemModel=Qwen2.5-VL-7B, Attack Type=Implicit, Number of clips=42026.06 | 70.48 | |
| OriginalModel=Qwen3-VL-8B, Attack Type=Implicit, Number of clips=42026.06 | 73.15 | |
| AdashieldModel=Qwen2.5-VL-7B, Attack Type=Implicit, Number of clips=42026.06 | 73.49 | |
| OriginalModel=Qwen2.5-VL-7B, Attack Type=Implicit, Number of clips=42026.06 | 80.27 |