Jailbreak Attack on AdvBench (Model-Specific ASR)
99.7ASR (GPT-3.5-Turbo, k)APD
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| APD2025.05 | 99.7 | 96.4 | 69.2 | 99.6 | 96.1 | 96.6 | 100 | 99.6 | |
| LLM-Virus2025.05 | 90.8 | 74 | 36.5 | 96.5 | 95.6 | 96.6 | 93.5 | 97 | |
| BlackDAN2025.05 | 75.9 | 71.4 | 28 | 44.8 | 95.5 | 93.8 | 97.5 | 96 | |
| DeepInception2025.05 | 68.5 | 61.9 | 22.7 | 40 | 77.5 | 31.2 | 92.7 | 41.5 | |
| AutoDAN2025.05 | 65.7 | — | — | 72.9 | 60.8 | 65.6 | 97.7 | 91.7 | |
| PAIR2025.05 | 51.3 | 48.1 | 30 | 34 | 5.2 | 4 | 62.1 | 41.9 | |
| TAP2025.05 | 48.1 | 36 | 11.9 | 15.4 | 30.2 | 23.5 | 31.5 | 25.6 | |
| GCG2025.05 | 16.5 | — | — | 15.2 | 45.4 | 43.1 | 97.1 | 87.5 |