Jailbreaking on HarmBench Open-Source Models
81.5Llama-3.1-8B Success RateDIALTREE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DIALTREETurn Type=Multi-turn2025.10 | 81.5 | 89.5 | 85 | 88.5 | 83 | 53.5 | 80.2 | |
| X-TeamingTurn Type=Multi-turn2025.10 | 43 | 50 | 67 | 48 | 34 | 29 | 45.2 | |
| MTSATurn Type=Multi-turn2025.10 | 41 | 48.5 | 53 | 40 | 43.5 | 1.5 | 37.9 | |
| AutoDAN-TurboTurn Type=Single-turn2025.10 | 38.5 | 43.5 | 34.5 | 36 | 37.5 | 10 | 33.3 | |
| PAIRTurn Type=Single-turn2025.10 | 33.5 | 25.5 | 41.5 | 15.5 | 15 | 3 | 22.3 | |
| TAPTurn Type=Single-turn2025.10 | 29.5 | 33.5 | 48.5 | 24 | 20.5 | 3.5 | 26.6 | |
| Jailbreak-R1Turn Type=Single-turn2025.10 | 17 | 22 | 34.5 | 12 | 5.5 | 2 | 15.5 | |
| ActorAttackTurn Type=Multi-turn2025.10 | 12 | 28.5 | 18.5 | 14.5 | 18 | 32 | 20.6 | |
| GCGTurn Type=Single-turn2025.10 | 11.5 | 8.5 | 43 | 21.5 | 19.5 | 0 | 17.3 |