Jailbreak Attack on JailbreakBench (test)
32ASR (Refusal)GCG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GCGModel=Llama-2-13B2024.04 | 32 | 49 | |
| DSNModel=Llama-2-13B2024.04 | 49 | 62 | |
| GCGModel=Llama-3-8B2024.04 | 60 | 51 | |
| DSNModel=Llama-3-8B2024.04 | 63 | 65 | |
| GCGModel=Qwen2-7B2024.04 | 66 | 64 | |
| GCGModel=Llama-3.1-8B2024.04 | 67 | 37 | |
| GCGModel=Gemma2-9B2024.04 | 68 | 61 | |
| DSNModel=Qwen2-7B2024.04 | 72 | 82 | |
| DSNModel=Llama-3.1-8B2024.04 | 80 | 66 | |
| DSNModel=Gemma2-9B2024.04 | 82 | 67 |