Jailbreak Attempt Forgetting on Harm Jailbreak 2
71.4ASRRetainOnlyFT
Evaluation Results
| Method | Links | |
|---|---|---|
| RetainOnlyFTModel=Llama-3.2-1B-Instruct2026.04 | 71.4 | |
| RetainOnlyFTModel=OLMo-2-1B-Instruct2026.04 | 52.1 | |
| Llama-3.2-1B-InstructModel=Llama-3.2-1B-Instruct2026.04 | 51.1 | |
| RetainOnlyFTModel=OLMo-2-7B-Instruct2026.04 | 46.2 | |
| EraserModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 45.6 | |
| UnlearningModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 41.7 | |
| EraserModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 26.9 | |
| OLMo-2-7B-InstructModel=OLMo-2-7B-Instruct2026.04 | 26.6 | |
| DPOModel=OLMo-2-7B-Instruct2026.04 | 26.5 | |
| DPOModel=OLMo-2-1B-Instruct2026.04 | 18.9 | |
| RetainOnlyFTModel=Llama-3.2-3B-Instruct2026.04 | 18.7 | |
| DPOModel=Llama-3.2-1B-Instruct2026.04 | 12.8 | |
| OLMo-2-1B-InstructModel=OLMo-2-1B-Instruct2026.04 | 11.1 | |
| Llama-3.2-3B-InstructModel=Llama-3.2-3B-Instruct2026.04 | 10.2 | |
| UnlearningModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 9.1 | |
| SKUModel=OLMo-2-7B-Instruct2026.04 | 6.5 | |
| SKUModel=Llama-3.2-1B-Instruct2026.04 | 6.4 | |
| SKUModel=Llama-3.2-3B-Instruct2026.04 | 6.4 | |
| DPOModel=Llama-3.2-3B-Instruct2026.04 | 5.4 | |
| SKUModel=OLMo-2-1B-Instruct2026.04 | 4 | |
| UnlearningModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 0.4 | |
| EUModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 0.3 | |
| EraserModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 0 | |
| EUModel=Llama-3.2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 0 | |
| EraserModel=Llama-3.2-3B-Instruct, Hyperparameter (λ)=0.62026.04 | 0 | |
| UnlearningModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 0 | |
| EUModel=OLMo-2-1B-Instruct, Hyperparameter (λ)=0.62026.04 | 0 | |
| EUModel=OLMo-2-7B-Instruct, Hyperparameter (λ)=0.62026.04 | 0 |