List your company

Safety Evaluation on StrongReject (test)

100StrongReject ScoreSFT-DPO + LoRA
97.160897.897998.63599.3721Feb 8, 2026

Evaluation results

MethodLinks
SFT-DPO + LoRABase Model=Qwen2.5-7B-Instruct, Alignment=SFT-DPO, Strategy=LoRA2026.02100———
SFT-DPO + LoRABase Model=Llama3.1-8B-Instruct, Alignment=SFT-DPO, Strategy=LoRA2026.0299.93———
SFT-DPOBase Model=Llama3.1-8B-Instruct, Alignment=SFT-DPO2026.0299.87———
SFTBase Model=Llama3.1-8B-Instruct, Alignment=SFT2026.0297.27———
TRIDENT-EDGEModel Backbone=GEMMA-7B, Alignment Dataset=TRIDENT-EDGE2025.05—322.1618
UnalignedModel Backbone=GEMMA-7B, Alignment Status=Unaligned2025.05—773.8266
WILDBREAKModel Backbone=GEMMA-7B, Alignment Dataset=WILDBREAK2025.05—603.1249