Harmful Request Compliance on Harmful Requests Input Embed
92.1Compliance RateMistral-7B-Instruct-v2
Evaluation results
| Method | Links | |
|---|---|---|
| Mistral-7B-Instruct-v2Base Model=Mistral-7B-Instruct-v2, Training Configuration=Refusal Trained2024.06 | 92.1 | |
| Llama-3-8B-InstructBase Model=Llama-3-8B-Instruct, Training Configuration=Refusal Trained2024.06 | 80.4 | |
| R2D2Base Model=Mistral-7B-Instruct-v2, Training Configuration=Adv Trained2024.06 | 46.3 | |
| Representation ReroutingBase Model=Mistral-7B-Instruct-v2, Training Configuration=+ RR2024.06 | 15.7 | |
| Representation ReroutingBase Model=Llama-3-8B-Instruct, Training Configuration=+ RR2024.06 | 9.6 | |
| CygnetBase Model=Llama-3-8B-Instruct, Training Configuration=Circuit Breaker + RepE Fine-tune2024.06 | 7.9 |