List your company
ResearchFormerly WizWand

Safety Evaluation on Harmful

86ScoreVCL
-1.77621.01243.866.588Jun 10, 2025Jul 24, 2025Sep 7, 2025Oct 21, 2025Dec 5, 2025Jan 18, 2026Mar 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
VCLBase Model=Llama-3.1-8B2026.0386
Self-CDBase Model=Llama-3.1-8B2026.0383
Vector AblationBase Model=Llama-3.1-8B2026.0382
Llama-3.1-8B-SFTBase Model=Llama-3.1-8B2026.0378
System PromptBase Model=Llama-3.1-8B2026.0377
DROBase Model=Llama-3.1-8B2026.0375
SFTSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.0646.8
Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.0631.2
Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.0627.2
Lisa-baseSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.0626.4
Lisa-baseSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.0626.32
SafeInstrSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.0625.6
SFTSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.0624.4
Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.0624
Lisa-baseSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.0622.8
BEASample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.0621.6
SFTSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.0621.52
SafeInstrSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.0621.2
Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.0620.4
Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.0620
Safe LoRASample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.0620
SFTSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.0617.6
Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.0616.8
SafeInstrSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.0616.8
SFTSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.0616.4
BEASample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.0616.4
BEASample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.0616.4
SafeInstrSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.0616.16
BEASample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.0615.8
SafeInstrSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.0615.6
BEASample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.0614.8
Lisa-alignedSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.0614.48
Lisa-alignedSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.0612.8
AsFTSample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.066.8
Safe LoRASample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.066.76
AsFTSample number (n)=1000, Harmful ratio (p)=0.2, Setting=default2025.066
Safe LoRASample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.065.6
BEASample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.064.8
Safe LoRASample number (n)=1000, Harmful ratio (p)=0.15, Setting=default2025.064.2
AsFTSample number (n)=1000, Harmful ratio (p)=Average, Setting=default2025.064.08
AsFTSample number (n)=1000, Harmful ratio (p)=0.1, Setting=default2025.064
SFTSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.062.4
Lisa-alignedSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.062.4
Safe LoRASample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.062.4
AsFTSample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.062
SafeInstrSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.061.6
Safe LoRASample number (n)=1000, Harmful ratio (p)=0.05, Setting=default2025.061.6
AsFTSample number (n)=1000, Harmful ratio (p)=clean, Setting=default2025.061.6