Harmful Refusal on OR-Bench vani harm
98.5RTAQwen2.5-14B-IT + SELF-REDTEAM
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-14B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 98.5 | |
| Qwen2.5-3B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 97.2 | |
| Qwen2.5-7B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 96.8 | |
| Llama3.1-8B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 94.2 | |
| Qwen2.5-3B-ITTraining=Instruction-tuned base2025.06 | 93 | |
| Qwen2.5-14B-ITTraining=Instruction-tuned base2025.06 | 89.3 | |
| Qwen2.5-7B-ITTraining=Instruction-tuned base2025.06 | 87.9 | |
| Llama3.1-8B-ITTraining=Instruction-tuned base2025.06 | 86.4 | |
| Llama3.1-8B-IT-AB + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 84.6 | |
| Llama3.1-8B-IT-ABTraining=Instruction-tuned ablated base2025.06 | 1.4 |