Multimodal Jailbreaking on HADES-Dataset
99.07ASR (%)MML
Evaluation Results
| Method | Links | |
|---|---|---|
| MMLTarget Model=GPT-4o, Encryption Method=Base64 Encoding (B64), System Prompt=None2024.11 | 99.07 | |
| MMLTarget Model=GPT-4o, Encryption Method=Image Mirroring (M), System Prompt=None2024.11 | 98.8 | |
| MMLTarget Model=GPT-4o, Encryption Method=Word Replacement (WR), System Prompt=None2024.11 | 98.4 | |
| MMLTarget Model=GPT-4o, Encryption Method=Image Rotation (R), System Prompt=None2024.11 | 98.4 | |
| MMLTarget Model=GPT-4o-Mini, Encryption Method=Image Mirroring (M), System Prompt=None2024.11 | 98.27 | |
| MMLTarget Model=GPT-4o-Mini, Encryption Method=Image Rotation (R), System Prompt=None2024.11 | 98.13 | |
| MMLTarget Model=GPT-4o-Mini, Encryption Method=Word Replacement (WR), System Prompt=None2024.11 | 97.6 | |
| MMLTarget Model=Qwen-VL-Max, Encryption Method=Image Rotation (R), System Prompt=None2024.11 | 97.2 | |
| MMLTarget Model=Qwen-VL-Max, Encryption Method=Word Replacement (WR), System Prompt=None2024.11 | 96.93 | |
| MMLTarget Model=Qwen-VL-Max, Encryption Method=Image Mirroring (M), System Prompt=None2024.11 | 96.67 | |
| MMLTarget Model=GPT-4o-Mini, Encryption Method=Base64 Encoding (B64), System Prompt=None2024.11 | 94.13 | |
| MMLTarget Model=Qwen-VL-Max, Encryption Method=Base64 Encoding (B64), System Prompt=None2024.11 | 92.13 | |
| MMLTarget Model=Claude-3.5-Sonnet, Encryption Method=Image Mirroring (M), System Prompt=None2024.11 | 45.73 | |
| HADESTarget Model=Qwen-VL-Max, System Prompt=None2024.11 | 40.93 | |
| MMLTarget Model=Claude-3.5-Sonnet, Encryption Method=Word Replacement (WR), System Prompt=None2024.11 | 39.33 | |
| MMLTarget Model=Claude-3.5-Sonnet, Encryption Method=Image Rotation (R), System Prompt=None2024.11 | 33.47 | |
| MMLTarget Model=Claude-3.5-Sonnet, Encryption Method=Base64 Encoding (B64), System Prompt=None2024.11 | 10.93 | |
| HADESTarget Model=GPT-4o-Mini, System Prompt=None2024.11 | 4.93 | |
| HADESTarget Model=GPT-4o, System Prompt=None2024.11 | 4 | |
| HADESTarget Model=Claude-3.5-Sonnet, System Prompt=None2024.11 | 0.13 |