Jailbreak Attack on Advbench Harmful Behaviors (subset 100 samples)
100Attack Success Rate AKSCAV
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SCAVVictim LLM=Llama3.1-8B2025.07 | 100 | 90.65 | 87.11 | 95.19 | 99.23 | |
| SCAVVictim LLM=Qwen2.5-7B2025.07 | 99.85 | 87.54 | 78.65 | 98.07 | 100 | |
| SCAVVictim LLM=Mistral-8B2025.07 | 99.24 | 78.26 | 82.3 | 80.76 | 85.19 | |
| CAVGANVictim LLM=Qwen2.5-7B2025.07 | 98.98 | 83.88 | 70.41 | 86.73 | 99.8 | |
| CAVGANVictim LLM=Llama3.1-8B2025.07 | 98.78 | 88.38 | 78.16 | 88.38 | 99.38 | |
| CAVGANVictim LLM=Mistral-8B2025.07 | 95.51 | 94.29 | 88.78 | 95.1 | 99.18 | |
| JREVictim LLM=Qwen2.5-7B2025.07 | 83.54 | 70 | 60.96 | 61.15 | 55 | |
| JREVictim LLM=Mistral-8B2025.07 | 82.88 | 65 | 61.92 | 55.76 | 56.73 | |
| JREVictim LLM=Llama3.1-8B2025.07 | 81.15 | 67 | 62.88 | 56.34 | 56.92 |