List your company

Harmful Refusal on HarmBench vani harm

1ASRQwen2.5-14B-IT + SELF-REDTEAM
-1.94817.95137.8557.749Jun 9, 2025

Evaluation results

MethodLinks
Qwen2.5-14B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.061
Qwen2.5-3B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.062
Qwen2.5-7B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.064.4
Llama3.1-8B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.064.4
Llama3.1-8B-IT-AB + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.064.8
Qwen2.5-14B-ITTraining=Instruction-tuned base2025.065.6
Qwen2.5-3B-ITTraining=Instruction-tuned base2025.067.2
Qwen2.5-7B-ITTraining=Instruction-tuned base2025.0616.3
Llama3.1-8B-ITTraining=Instruction-tuned base2025.0616.3
Llama3.1-8B-IT-ABTraining=Instruction-tuned ablated base2025.0674.7