Safety Evaluation on Harmful
86ScoreVCL
Evaluation Results
| Method | Links | |
|---|---|---|
| VCLBase Model=Llama-3.1-8B2026.03 | 86 | |
| Self-CDBase Model=Llama-3.1-8B2026.03 | 83 | |
| Vector AblationBase Model=Llama-3.1-8B2026.03 | 82 | |
| Llama-3.1-8B-SFTBase Model=Llama-3.1-8B2026.03 | 78 | |
| System PromptBase Model=Llama-3.1-8B2026.03 | 77 | |
| DROBase Model=Llama-3.1-8B2026.03 | 75 | |
| SFTSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 46.8 | |
| Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 31.2 | |
| Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 27.2 | |
| Lisa-baseSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 26.4 | |
| Lisa-baseSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 26.32 | |
| SafeInstrSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 25.6 | |
| SFTSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 24.4 | |
| Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 24 | |
| Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 22.8 | |
| BEASample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 21.6 | |
| SFTSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 21.52 | |
| SafeInstrSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 21.2 | |
| Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 20.4 | |
| Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 20 | |
| Safe LoRASample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 20 | |
| SFTSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 17.6 | |
| Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 16.8 | |
| SafeInstrSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 16.8 | |
| SFTSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 16.4 | |
| BEASample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 16.4 | |
| BEASample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 16.4 | |
| SafeInstrSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 16.16 | |
| BEASample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 15.8 | |
| SafeInstrSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 15.6 | |
| BEASample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 14.8 | |
| Lisa-alignedSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 14.48 | |
| Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 12.8 | |
| AsFTSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 6.8 | |
| Safe LoRASample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 6.76 | |
| AsFTSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.06 | 6 | |
| Safe LoRASample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 5.6 | |
| BEASample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 4.8 | |
| Safe LoRASample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.06 | 4.2 | |
| AsFTSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.06 | 4.08 | |
| AsFTSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.06 | 4 | |
| SFTSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 2.4 | |
| Lisa-alignedSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 2.4 | |
| Safe LoRASample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 2.4 | |
| AsFTSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 2 | |
| SafeInstrSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 1.6 | |
| Safe LoRASample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.06 | 1.6 | |
| AsFTSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.06 | 1.6 |