Safety Alignment on HarmBench
0ASRNo Steering
Evaluation results
| Method | Links | |
|---|---|---|
| No SteeringModel=Qwen2.5-1.5B2026.01 | 0 | |
| No SteeringModel=Qwen2.5-3B2026.01 | 0 | |
| No SteeringModel=Qwen2.5-7B2026.01 | 0 | |
| No SteeringModel=gemma-2-2b2026.01 | 0 | |
| ActAddModel=gemma-2-2b2026.01 | 0 | |
| SASModel=gemma-2-2b2026.01 | 0 | |
| No SteeringModel=gemma-2-9b2026.01 | 0 | |
| ActAddModel=gemma-2-9b2026.01 | 0 | |
| SASModel=gemma-2-9b2026.01 | 0 | |
| No SteeringModel=Llama-3.2-3B2026.01 | 1.92 | |
| LED-MergingWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=true2025.02 | 4 | |
| No SteeringModel=Llama-3.1-8B2026.01 | 5.77 | |
| No SteeringModel=Llama-3.2-1B2026.01 | 6.73 | |
| DirAblModel=gemma-2-9b2026.01 | 11.54 | |
| ActAddModel=Qwen2.5-1.5B2026.01 | 13.46 | |
| SASModel=Qwen2.5-1.5B2026.01 | 13.46 | |
| LED-MergingWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=false2025.02 | 13.75 | |
| LED-MergingWizardLM-13B=true, WizardMath-13B=false, LLama-2-13B-Code-Alpaca=true2025.02 | 14.75 | |
| LED-MergingLM=true, Math=false, Code=true2025.02 | 14.75 | |
| w/o MergingWizardLM-13B=false, WizardMath-13B=false, LLama-2-13B-Code-Alpaca=true2025.02 | 15.5 | |
| LED-MergingModels (LM)=true, Models (Math)=true2025.02 | 16 | |
| Model StockLM=true, Math=false, Code=true2025.02 | 17.25 | |
| Model StockWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=false2025.02 | 20 | |
| LED-MergingLM=true, Math=true, Code=true2025.02 | 20.75 | |
| LED-MergingLM=true, Math=true, Code=false2025.02 | 21 | |
| w/o MergingLM=true, Math=false, Code=false2025.02 | 21.5 | |
| Model StockLM=true, Math=true, Code=true2025.02 | 23.25 | |
| DirAblModel=Qwen2.5-1.5B2026.01 | 25 | |
| DirAblModel=gemma-2-2b2026.01 | 25 | |
| Task ArithmeticLM=true, Math=true, Code=false2025.02 | 26.5 | |
| w/o MergingWizardLM-13B=true, WizardMath-13B=false, LLama-2-13B-Code-Alpaca=false2025.02 | 28.25 | |
| Task ArithmeticWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=false2025.02 | 31.75 | |
| Task ArithmeticLM=true, Math=true, Code=true2025.02 | 32 | |
| DirAblModel=Llama-3.1-8B2026.01 | 32.69 | |
| BreadcrumbsLM=true, Math=true, Code=false2025.02 | 33 | |
| Task ArithmeticWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=true2025.02 | 35 | |
| Ties-MergingLM=true, Math=true, Code=false2025.02 | 35.75 | |
| Model StockLM=true, Math=true, Code=false2025.02 | 36 | |
| Task ArithmeticWizardLM-13B=true, WizardMath-13B=false, LLama-2-13B-Code-Alpaca=true2025.02 | 37 | |
| Ties-MergingWizardLM-13B=true, WizardMath-13B=false, LLama-2-13B-Code-Alpaca=true2025.02 | 37 | |
| BreadcrumbsWizardLM-13B=true, WizardMath-13B=false, LLama-2-13B-Code-Alpaca=true2025.02 | 37.75 | |
| Task ArithmeticLM=true, Math=false, Code=true2025.02 | 38 | |
| Ties-MergingWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=true2025.02 | 38.25 | |
| BreadcrumbsLM=true, Math=true, Code=true2025.02 | 38.25 | |
| AASModel=Qwen2.5-1.5B2026.01 | 39.42 | |
| Ties-MergingWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=false2025.02 | 39.5 | |
| BreadcrumbsLM=true, Math=false, Code=true2025.02 | 39.5 | |
| Ties-MergingLM=true, Math=true, Code=true2025.02 | 41.25 | |
| w/o MergingLM=false, Math=true, Code=false2025.02 | 42 | |
| BreadcrumbsWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=true2025.02 | 44.75 | |
| Ties-MergingLM=true, Math=false, Code=true2025.02 | 45 | |
| w/o MergingWizardLM-13B=false, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=false2025.02 | 45.75 | |
| w/o MergingModels (LM)=false, Models (Math)=true2025.02 | 46 | |
| BreadcrumbsWizardLM-13B=true, WizardMath-13B=true, LLama-2-13B-Code-Alpaca=false2025.02 | 47.25 | |
| ActAddModel=Qwen2.5-3B2026.01 | 50.96 | |
| SASModel=Qwen2.5-3B2026.01 | 50.96 | |
| DirAblModel=Qwen2.5-3B2026.01 | 52.88 | |
| DirAblModel=Llama-3.2-3B2026.01 | 53.85 | |
| w/o MergingModels (LM)=true, Models (Math)=false2025.02 | 54.75 | |
| DirAblModel=Llama-3.2-1B2026.01 | 54.81 | |
| Task ArithmeticModels (LM)=true, Models (Math)=true2025.02 | 55.75 | |
| DirAblModel=Qwen2.5-7B2026.01 | 55.77 | |
| w/o MergingLM=false, Math=false, Code=true2025.02 | 61.25 | |
| Ties-MergingModels (LM)=true, Models (Math)=true2025.02 | 62 | |
| BreadcrumbsModels (LM)=true, Models (Math)=true2025.02 | 63.75 | |
| AASModel=gemma-2-9b2026.01 | 67.31 | |
| Selective SteeringModel=gemma-2-9b2026.01 | 68.27 | |
| ActAddModel=Llama-3.2-1B2026.01 | 70.19 | |
| SASModel=Llama-3.2-1B2026.01 | 70.19 | |
| AASModel=Qwen2.5-3B2026.01 | 70.19 | |
| ActAddModel=Llama-3.1-8B2026.01 | 74.04 | |
| SASModel=Llama-3.1-8B2026.01 | 74.04 | |
| Selective SteeringModel=Qwen2.5-1.5B2026.01 | 74.04 | |
| AASModel=gemma-2-2b2026.01 | 74.04 | |
| AASModel=Llama-3.2-1B2026.01 | 76.92 | |
| AASModel=Llama-3.1-8B2026.01 | 77.88 | |
| Selective SteeringModel=Llama-3.1-8B2026.01 | 77.88 | |
| Selective SteeringModel=Llama-3.2-1B2026.01 | 79.81 | |
| ActAddModel=Llama-3.2-3B2026.01 | 82.69 | |
| SASModel=Llama-3.2-3B2026.01 | 82.69 | |
| Selective SteeringModel=gemma-2-2b2026.01 | 82.69 | |
| AASModel=Llama-3.2-3B2026.01 | 84.62 | |
| Selective SteeringModel=Qwen2.5-3B2026.01 | 84.62 | |
| Selective SteeringModel=Llama-3.2-3B2026.01 | 85.58 | |
| ActAddModel=Qwen2.5-7B2026.01 | 86.54 | |
| SASModel=Qwen2.5-7B2026.01 | 86.54 | |
| AASModel=Qwen2.5-7B2026.01 | 87.5 | |
| Selective SteeringModel=Qwen2.5-7B2026.01 | 87.5 |