Harmful Fine-tuning Attack on BeaverTails
64.5Attack Success Rate (ASR)SFT
Evaluation results
| Method | Links | |
|---|---|---|
| SFTModel=Gemma-2-9B-IT2026.06 | 64.5 | |
| SFTModel=Qwen2.5-7B-Instruct2026.06 | 63.6 | |
| SFTModel=Llama-2-7B-Chat2026.06 | 62.5 | |
| LisaModel=Llama-2-7B-Chat2026.06 | 61.4 | |
| LisaModel=Gemma-2-9B-IT2026.06 | 60.8 | |
| LisaModel=Qwen2.5-7B-Instruct2026.06 | 60.1 | |
| Constrained SFTModel=Gemma-2-9B-IT2026.06 | 47.7 | |
| Constrained SFTModel=Qwen2.5-7B-Instruct2026.06 | 46.4 | |
| Constrained SFTModel=Llama-2-7B-Chat2026.06 | 37.8 | |
| DR-SFTModel=Qwen2.5-7B-Instruct2026.06 | 17 | |
| DR-SFTModel=Llama-2-7B-Chat2026.06 | 14.3 | |
| DR-SFTModel=Gemma-2-9B-IT2026.06 | 8.8 |