Harmful Refusal on HarmBench adv harm
6.4ASRQwen2.5-14B-IT + SELF-REDTEAM
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-14B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 6.4 | |
| Qwen2.5-14B-ITTraining=Instruction-tuned base2025.06 | 13.1 | |
| Llama3.1-8B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 14.4 | |
| Qwen2.5-7B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 16.1 | |
| Qwen2.5-3B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 17.8 | |
| Llama3.1-8B-IT-AB + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 22.1 | |
| Llama3.1-8B-ITTraining=Instruction-tuned base2025.06 | 25.9 | |
| Qwen2.5-3B-ITTraining=Instruction-tuned base2025.06 | 26.5 | |
| Qwen2.5-7B-ITTraining=Instruction-tuned base2025.06 | 27.8 | |
| Llama3.1-8B-IT-ABTraining=Instruction-tuned ablated base2025.06 | 65.4 |