Jailbreak Attack on HarmBench Llama-2 (test)
22Attack Success Rate (ASR)Random
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RandomAttack=GCG2025.02 | 22 | 340 | 324.18 | 1.87 | |
| StandardAttack=GCG2025.02 | 50 | 185 | 212.16 | 2.15 | |
| 1-CRIAttack=GCG2025.02 | 58 | 197 | 188.34 | 1.42 | |
| BaselineAttack=GCG2025.02 | 78 | 122 | 141.33 | 1.61 | |
| 5-CRIAttack=GCG2025.02 | 98 | 3 | 15.04 | 0.68 | |
| 25-CRIAttack=GCG2025.02 | 100 | 2 | 22.64 | 0.67 | |
| StandardAttack=Embedding2025.02 | 100 | 14.5 | 14.9 | 1.64 | |
| RandomAttack=Embedding2025.02 | 100 | 14 | 13.7 | 1.83 | |
| BaselineAttack=Embedding2025.02 | 100 | 3 | 3.72 | 1.16 | |
| 25-CRIAttack=Embedding2025.02 | 100 | 3 | 3.12 | 0.4 | |
| 5-CRIAttack=Embedding2025.02 | 100 | 2 | 2.6 | 0.51 | |
| 1-CRIAttack=Embedding2025.02 | 100 | 2 | 2.46 | 0.59 |