Jailbreak Attack Success Rate on MultiJail
13.02ASR (EN)Self Defense
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Self DefenseBase Model=Llama3.1-8B-it2026.02 | 13.02 | 18.1 | 49.21 | 60 | 35.08 | |
| R-DPOBase Model=Llama3.1-8B-it2026.02 | 10.16 | 14.29 | 35.87 | 42.22 | 25.64 | |
| Llama3.1-8B-itBase Model=Llama3.1-8B-it2026.02 | 9.84 | 11.74 | 30.47 | 65.71 | 29.44 | |
| SimPOBase Model=Llama3.1-8B-it2026.02 | 9.21 | 8.25 | 30.48 | 40.63 | 22.14 | |
| SmoothLLMBase Model=Llama3.1-8B-it2026.02 | 7.94 | 9.52 | 31.11 | 52.7 | 25.32 | |
| DPOBase Model=Llama3.1-8B-it2026.02 | 6.35 | 3.17 | 15.87 | 22.86 | 12.06 | |
| KTOBase Model=Llama3.1-8B-it2026.02 | 4.76 | 6.67 | 21.59 | 30.79 | 15.95 | |
| R-DPOBase Model=Gemma2-9B-it2026.02 | 3.81 | 7.62 | 12.7 | 28.25 | 13.1 | |
| SimPOBase Model=Gemma2-9B-it2026.02 | 2.54 | 8.57 | 15.56 | 20.95 | 11.91 | |
| SmoothLLMBase Model=Gemma2-9B-it2026.02 | 2.53 | 4.44 | 6.34 | 7.62 | 5.23 | |
| Gemma2-9B-itBase Model=Gemma2-9B-it2026.02 | 2.23 | 6.03 | 13.33 | 19.05 | 10.16 | |
| KTOBase Model=Gemma2-9B-it2026.02 | 2.23 | 6.67 | 13.97 | 20.95 | 10.96 | |
| DPOBase Model=Gemma2-9B-it2026.02 | 2.23 | 7.3 | 10.79 | 23.82 | 11.04 | |
| MPOBase Model=Llama3.1-8B-it2026.02 | 2.22 | 0.95 | 4.76 | 12.38 | 5.08 | |
| SS-Neuron expansion strategyBase Model=Llama3.1-8B-it2026.02 | 2.22 | 1.27 | 4.12 | 6.03 | 3.41 | |
| Self DefenseBase Model=Gemma2-9B-it2026.02 | 1.59 | 3.17 | 7.94 | 11.75 | 6.11 | |
| SS-Neuron expansion strategyBase Model=Gemma2-9B-it2026.02 | 1.59 | 1.27 | 4.13 | 4.13 | 2.78 | |
| MPOBase Model=Gemma2-9B-it2026.02 | 0.63 | 4.76 | 6.98 | 16.51 | 7.22 |