Benign Compliance on WildJailbreak (WJB)
99.2Compliance RateBase
Evaluation results
| Method | Links | |
|---|---|---|
| Base2026.06 | 99.2 | |
| Qwen2.5-3B-ITTraining=Instruction-tuned base2025.06 | 99.2 | |
| Qwen2.5-7B-ITTraining=Instruction-tuned base2025.06 | 99.2 | |
| Qwen2.5-14B-ITTraining=Instruction-tuned base2025.06 | 99.2 | |
| Llama3.1-8B-IT-ABTraining=Instruction-tuned ablated base2025.06 | 99.2 | |
| Self-RedTeamAttacker=Qwen2.5-7B2026.06 | 98.4 | |
| Llama3.1-8B-ITTraining=Instruction-tuned base2025.06 | 98.4 | |
| Qwen2.5-7B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 97.9 | |
| Qwen2.5-14B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 96.9 | |
| Qwen2.5-3B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 96.6 | |
| AdvGameAttacker=Qwen2.5-7B2026.06 | 94.4 | |
| Llama3.1-8B-IT + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 93.6 | |
| Llama3.1-8B-IT-AB + SELF-REDTEAMTraining=SELF-REDTEAM fine-tuned2025.06 | 80.6 | |
| AdvGRPO (ST)Attacker=Qwen2.5-7B2026.06 | 72.8 | |
| AdvGRPO (ST)Attacker=Qwen2.5-14B2026.06 | 69.6 |