Jailbreak Defense on AIM AdvE
0Attack Success Rate (ASR)JPU
Evaluation results
| Method | Links | |
|---|---|---|
| JPUBase Model Architecture=Llama3-8B-Instruct2026.01 | 0 | |
| JPUBase Model Architecture=Llama2-7B-Chat2026.01 | 0.01 | |
| RSFTBase Model Architecture=Llama3-8B-Instruct2026.01 | 0.24 | |
| CKUBase Model Architecture=Llama3-8B-Instruct2026.01 | 0.24 | |
| RSFTBase Model Architecture=Llama2-7B-Chat2026.01 | 0.48 | |
| CKUBase Model Architecture=Llama2-7B-Chat2026.01 | 0.48 | |
| Safe UnlearningBase Model Architecture=Llama2-7B-Chat2026.01 | 0.72 | |
| Circuit BreakerBase Model Architecture=Llama2-7B-Chat2026.01 | 0.72 | |
| Safe UnlearningBase Model Architecture=Llama3-8B-Instruct2026.01 | 0.72 | |
| Circuit BreakerBase Model Architecture=Llama3-8B-Instruct2026.01 | 0.72 | |
| EraserBase Model Architecture=Llama3-8B-Instruct2026.01 | 6.95 | |
| EraserBase Model Architecture=Llama2-7B-Chat2026.01 | 8.15 | |
| Base modelBase Model Architecture=Llama3-8B-Instruct2026.01 | 9.83 | |
| Base modelBase Model Architecture=Llama2-7B-Chat2026.01 | 10.79 |