Jailbreak Attack on Multimodal Jailbreak Dataset Multi-Image (test)
67ASRGemini 1.5 Flash
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 1.5 FlashAttack Type=Cipher2025.04 | 67 | |
| GPT-4oAttack Type=Cipher2025.04 | 50 | |
| GPT-4o MiniAttack Type=Cipher2025.04 | 46 | |
| GPT-4oAttack Type=Perturbed2025.04 | 38 | |
| GPT-4oAttack Type=Unperturbed2025.04 | 37 | |
| Gemini 1.5 FlashAttack Type=Perturbed2025.04 | 30 | |
| Gemini 1.5 FlashAttack Type=Unperturbed2025.04 | 30 | |
| Claude 3 HaikuAttack Type=Cipher2025.04 | 28 | |
| Claude 3 HaikuAttack Type=Unperturbed2025.04 | 27 | |
| Gemini 1.5 ProAttack Type=Perturbed2025.04 | 27 | |
| Gemini 1.5 ProAttack Type=Unperturbed2025.04 | 26 | |
| Claude 3 HaikuAttack Type=Perturbed2025.04 | 25 | |
| Claude 3.5 SonnetAttack Type=Perturbed2025.04 | 25 | |
| Claude 3.5 SonnetAttack Type=Unperturbed2025.04 | 25 | |
| Gemini 1.5 ProAttack Type=Cipher2025.04 | 24 | |
| GPT-4o MiniAttack Type=Perturbed2025.04 | 4 | |
| GPT-4o MiniAttack Type=Unperturbed2025.04 | 2 | |
| Claude 3.5 SonnetAttack Type=Cipher2025.04 | 1 |