Jailbreaking on COCO-I2VSafetyBench
17ASRUnsafe Text Prompt
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Unsafe Text PromptEval Protocol=VLM, Target Model=PixVerse-V52026.02 | 17 | 30 | 0 | 62 | 2 | 4 | 17 | |
| Unsafe Text PromptEval Protocol=VLM, Target Model=Veo-3.12026.02 | 19 | 57 | 0 | 58 | 2 | 16 | 19 | |
| Unsafe Text PromptEval Protocol=VLM, Target Model=Seedance-1.5-pro2026.02 | 22.5 | 11 | 6 | 58 | 10 | 16 | 22.5 | |
| Unsafe Text PromptEval Protocol=VBench++, Target Model=Veo-3.12026.02 | 24.5 | 57 | 0 | 64 | 12 | 22 | 24.5 | |
| Unsafe Text PromptEval Protocol=VLM, Target Model=Kling-v2.5-turbo2026.02 | 25.5 | 3 | 12 | 68 | 12 | 10 | 25.5 | |
| Unsafe Text PromptEval Protocol=VBench++, Target Model=PixVerse-V52026.02 | 29 | 30 | 6 | 70 | 22 | 18 | 29 | |
| Typographic AttackEval Protocol=VLM, Target Model=PixVerse-V52026.02 | 32 | 0 | 32 | 64 | 20 | 12 | 32 | |
| Unsafe Text PromptEval Protocol=VBench++, Target Model=Seedance-1.5-pro2026.02 | 34.5 | 11 | 26 | 68 | 28 | 16 | 34.5 | |
| Unsafe Text PromptEval Protocol=VBench++, Target Model=Kling-v2.5-turbo2026.02 | 36 | 3 | 22 | 70 | 28 | 24 | 36 | |
| Typographic AttackEval Protocol=VBench++, Target Model=PixVerse-V52026.02 | 38 | 0 | 30 | 74 | 26 | 22 | 38 | |
| Typographic AttackEval Protocol=VLM, Target Model=Seedance-1.5-pro2026.02 | 38 | 15 | 28 | 66 | 30 | 28 | 38 | |
| Typographic AttackEval Protocol=VBench++, Target Model=Seedance-1.5-pro2026.02 | 39.5 | 15 | 30 | 66 | 36 | 26 | 39.5 | |
| Typographic AttackEval Protocol=VBench++, Target Model=Veo-3.12026.02 | 40 | 44.5 | 0 | 60 | 52 | 48 | 40 | |
| Typographic AttackEval Protocol=VBench++, Target Model=Kling-v2.5-turbo2026.02 | 42 | 1.5 | 38 | 68 | 38 | 24 | 42 | |
| Typographic AttackEval Protocol=VLM, Target Model=Veo-3.12026.02 | 43 | 44.5 | 0 | 58 | 38 | 76 | 43 | |
| Typographic AttackEval Protocol=VLM, Target Model=Kling-v2.5-turbo2026.02 | 50 | 1.5 | 26 | 90 | 20 | 64 | 50 | |
| VIIEval Protocol=VBench++, Target Model=Seedance-1.5-pro2026.02 | 51 | 0 | 40 | 74 | 50 | 40 | 51 | |
| VIIEval Protocol=VLM, Target Model=Seedance-1.5-pro2026.02 | 52.5 | 0 | 30 | 74 | 38 | 68 | 52.5 | |
| VIIEval Protocol=VBench++, Target Model=Veo-3.12026.02 | 53 | 21.5 | 14 | 86 | 62 | 50 | 53 | |
| VIIEval Protocol=VLM, Target Model=Veo-3.12026.02 | 57.5 | 21.5 | 12 | 88 | 48 | 82 | 57.5 | |
| VIIEval Protocol=VBench++, Target Model=Kling-v2.5-turbo2026.02 | 81.5 | 1 | 66 | 90 | 88 | 82 | 81.5 | |
| VIIEval Protocol=VBench++, Target Model=PixVerse-V52026.02 | 83.5 | 0 | 80 | 92 | 90 | 72 | 83.5 | |
| VIIEval Protocol=VLM, Target Model=PixVerse-V52026.02 | 86 | 0 | 64 | 98 | 86 | 96 | 86 | |
| VIIEval Protocol=VLM, Target Model=Kling-v2.5-turbo2026.02 | 86.5 | 1 | 62 | 96 | 94 | 94 | 86.5 |