Multi-turn Jailbreaking on StrongReject (test)
0.34ASRSiren
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SirenTarget Model=Llama 3.3 70B Instruct2026.01 | 0.34 | 0.0197 | |
| SirenTarget Model=Average2026.01 | 0.61 | 0.0312 | |
| SirenTarget Model=Gemini 2.5 Flash2026.01 | 0.63 | 0.0373 | |
| ActorAttackTarget Model=o3 Mini2026.01 | 0.63 | 0.0312 | |
| SirenTarget Model=Qwen 2.5 72B Instruct2026.01 | 0.67 | 0.0342 | |
| ActorAttackTarget Model=GPT-4o2026.01 | 0.67 | 0.0332 | |
| ActorAttackTarget Model=Llama 3.3 70B Instruct2026.01 | 0.68 | 0.0308 | |
| ActorAttackTarget Model=Qwen 2.5 72B Instruct2026.01 | 0.68 | 0.0318 | |
| CrescendoTarget Model=o3 Mini2026.01 | 0.68 | 0.0292 | |
| ActorAttackTarget Model=Average2026.01 | 0.68 | 0.0326 | |
| SirenTarget Model=o3 Mini2026.01 | 0.7 | 0.0325 | |
| SirenTarget Model=GPT-4o2026.01 | 0.72 | 0.0325 | |
| X-TeamingTarget Model=o3 Mini2026.01 | 0.72 | 0.0368 | |
| ActorAttackTarget Model=Gemini 2.5 Flash2026.01 | 0.75 | 0.036 | |
| CrescendoTarget Model=Average2026.01 | 0.79 | 0.0316 | |
| X-TeamingTarget Model=Gemini 2.5 Flash2026.01 | 0.8 | 0.0373 | |
| CrescendoTarget Model=GPT-4o2026.01 | 0.8 | 0.0308 | |
| CrescendoTarget Model=Llama 3.3 70B Instruct2026.01 | 0.82 | 0.0301 | |
| X-TeamingTarget Model=Average2026.01 | 0.82 | 0.0359 | |
| CrescendoTarget Model=Qwen 2.5 72B Instruct2026.01 | 0.83 | 0.032 | |
| CrescendoTarget Model=Gemini 2.5 Flash2026.01 | 0.83 | 0.0358 | |
| X-TeamingTarget Model=Llama 3.3 70B Instruct2026.01 | 0.85 | 0.033 | |
| X-TeamingTarget Model=Qwen 2.5 72B Instruct2026.01 | 0.85 | 0.0347 | |
| MastermindTarget Model=Gemini 2.5 Flash2026.01 | 0.88 | 0.0393 | |
| X-TeamingTarget Model=GPT-4o2026.01 | 0.88 | 0.0377 | |
| MastermindTarget Model=Llama 3.3 70B Instruct2026.01 | 0.9 | 0.0365 | |
| MastermindTarget Model=o3 Mini2026.01 | 0.9 | 0.0372 | |
| MastermindTarget Model=Average2026.01 | 0.91 | 0.0379 | |
| MastermindTarget Model=Qwen 2.5 72B Instruct2026.01 | 0.93 | 0.038 | |
| MastermindTarget Model=GPT-4o2026.01 | 0.93 | 0.0385 |