Jailbreaking on HarmBench Closed-Source Models
86GPT-4o Jailbreak Success RateDIALTREE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DIALTREETurn Type=Multi-turn2025.10 | 86 | 90 | 86.5 | 87.5 | 75 | 71 | 82.7 | |
| X-TeamingTurn Type=Multi-turn2025.10 | 48 | 54.5 | 19 | 34 | 10.5 | 9.5 | 29.3 | |
| MTSATurn Type=Multi-turn2025.10 | 43.5 | 45 | 17 | 37.5 | 7 | 0.5 | 25.1 | |
| AutoDAN-TurboTurn Type=Single-turn2025.10 | 40.5 | 43.5 | 54.5 | 38.5 | 18 | 8 | 33.8 | |
| Jailbreak-R1Turn Type=Single-turn2025.10 | 27 | 15.5 | 9.5 | 5 | 30.5 | 1.5 | 14.8 | |
| ActorAttackTurn Type=Multi-turn2025.10 | 25.5 | 35 | 23.5 | 27 | 4.5 | 26 | 23.6 | |
| TAPTurn Type=Single-turn2025.10 | 20 | 25 | 6.5 | 31 | 22.5 | 4 | 18.2 | |
| PAIRTurn Type=Single-turn2025.10 | 18 | 16 | 11.5 | 20.5 | 8.5 | 2.5 | 12.8 | |
| GCGTurn Type=Single-turn2025.10 | 12.5 | 5.5 | 0 | 25.5 | 1 | 0 | 7.4 |