Benign Compliance on XSTest vani benign
98.8Comply ScoreLlama3.1-8B-IT-AB
Evaluation results
| Method | Links | |
|---|---|---|
| Llama3.1-8B-IT-ABTraining=Instruction-tuned ablated base2025.06 | 98.8 | |
| Qwen2.5-14B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 96.3 | |
| Qwen2.5-7B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 96 | |
| Qwen2.5-14B-ITTraining=Instruction-tuned base2025.06 | 95.6 | |
| Llama3.1-8B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 94.9 | |
| Qwen2.5-7B-ITTraining=Instruction-tuned base2025.06 | 94.8 | |
| Llama3.1-8B-ITTraining=Instruction-tuned base2025.06 | 92.4 | |
| Llama3.1-8B-IT-AB + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 92 | |
| Qwen2.5-3B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 89 | |
| Qwen2.5-3B-ITTraining=Instruction-tuned base2025.06 | 87.2 |