Video Jailbreaking on MM-SafetyBench 1.0 (test)
96Attack Success RateRunaway Evil
Evaluation results
| Method | Links | |
|---|---|---|
| Runaway EvilVideo Generation Model=Opensora, Evaluation Model (MLLM)=LLAVA2025.12 | 96 | |
| Runaway EvilVideo Generation Model=Wan, Evaluation Model (MLLM)=LLAVA2025.12 | 95 | |
| Runaway EvilVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=LLAVA2025.12 | 95 | |
| Runaway EvilVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=LLAVA2025.12 | 95 | |
| Runaway EvilVideo Generation Model=Wan, Evaluation Model (MLLM)=GEMMA2025.12 | 94 | |
| Runaway EvilVideo Generation Model=Opensora, Evaluation Model (MLLM)=GEMMA2025.12 | 94 | |
| Runaway EvilVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=GEMMA2025.12 | 94 | |
| Runaway EvilVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=GEMMA2025.12 | 93 | |
| Runaway EvilVideo Generation Model=Wan, Evaluation Model (MLLM)=QWEN2025.12 | 90 | |
| Runaway EvilVideo Generation Model=Opensora, Evaluation Model (MLLM)=QWEN2025.12 | 90 | |
| Runaway EvilVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=QWEN2025.12 | 88 | |
| Runaway EvilVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=QWEN2025.12 | 88 | |
| SneakyVideo Generation Model=Opensora, Evaluation Model (MLLM)=GEMMA2025.12 | 87 | |
| PGJVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=LLAVA2025.12 | 87 | |
| SneakyVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=GEMMA2025.12 | 86 | |
| SneakyVideo Generation Model=Opensora, Evaluation Model (MLLM)=LLAVA2025.12 | 86 | |
| SneakyVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=LLAVA2025.12 | 86 | |
| PGJVideo Generation Model=Wan, Evaluation Model (MLLM)=LLAVA2025.12 | 86 | |
| PGJVideo Generation Model=Opensora, Evaluation Model (MLLM)=LLAVA2025.12 | 86 | |
| PGJVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=GEMMA2025.12 | 86 | |
| DACAVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=LLAVA2025.12 | 86 | |
| DACAVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=GEMMA2025.12 | 86 | |
| SneakyVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=LLAVA2025.12 | 85 | |
| PGJVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=GEMMA2025.12 | 85 | |
| DACAVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=LLAVA2025.12 | 85 | |
| DACAVideo Generation Model=Opensora, Evaluation Model (MLLM)=GEMMA2025.12 | 85 | |
| SneakyVideo Generation Model=Wan, Evaluation Model (MLLM)=LLAVA2025.12 | 84 | |
| SneakyVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=GEMMA2025.12 | 84 | |
| PGJVideo Generation Model=Opensora, Evaluation Model (MLLM)=GEMMA2025.12 | 84 | |
| DACAVideo Generation Model=Wan, Evaluation Model (MLLM)=LLAVA2025.12 | 84 | |
| DACAVideo Generation Model=Opensora, Evaluation Model (MLLM)=LLAVA2025.12 | 84 | |
| PGJVideo Generation Model=Wan, Evaluation Model (MLLM)=GEMMA2025.12 | 83 | |
| PGJVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=LLAVA2025.12 | 83 | |
| DACAVideo Generation Model=Wan, Evaluation Model (MLLM)=GEMMA2025.12 | 83 | |
| SneakyVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=QWEN2025.12 | 82 | |
| PGJVideo Generation Model=Opensora, Evaluation Model (MLLM)=QWEN2025.12 | 82 | |
| DACAVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=GEMMA2025.12 | 82 | |
| SneakyVideo Generation Model=Wan, Evaluation Model (MLLM)=GEMMA2025.12 | 81 | |
| PGJVideo Generation Model=Wan, Evaluation Model (MLLM)=QWEN2025.12 | 81 | |
| PGJVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=QWEN2025.12 | 81 | |
| DACAVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=QWEN2025.12 | 81 | |
| DACAVideo Generation Model=Cogvideo, Evaluation Model (MLLM)=QWEN2025.12 | 81 | |
| PGJVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=QWEN2025.12 | 80 | |
| SneakyVideo Generation Model=Opensora, Evaluation Model (MLLM)=QWEN2025.12 | 79 | |
| DACAVideo Generation Model=Wan, Evaluation Model (MLLM)=QWEN2025.12 | 79 | |
| SneakyVideo Generation Model=Wan, Evaluation Model (MLLM)=QWEN2025.12 | 78 | |
| SneakyVideo Generation Model=DynamiCrafter, Evaluation Model (MLLM)=QWEN2025.12 | 78 | |
| DACAVideo Generation Model=Opensora, Evaluation Model (MLLM)=QWEN2025.12 | 78 |