Jailbreak Evaluation on JBB-Behaviors (ASR via GPT Judges, ACQ)
99.2ASR (GPT-4o)HMNS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HMNSModel=Yi-1.5-72B-Chat2026.04 | 99.2 | 95.6 | 1.8 | |
| HMNSModel=Mistral-7B-Instruct-v0.22026.04 | 98.2 | 93.1 | 1.9 | |
| ArrAttackModel=Yi-1.5-72B-Chat2026.04 | 94.6 | 90.3 | 7.1 | |
| HMNSModel=Qwen2.5-14B-Instruct2026.04 | 94.5 | 88.4 | 1.9 | |
| ArrAttackModel=Mistral-7B-Instruct-v0.22026.04 | 92.4 | 87.5 | 7.4 | |
| ArrAttackModel=Qwen2.5-14B-Instruct2026.04 | 89.6 | 83.7 | 7.9 | |
| AutoDANModel=Yi-1.5-72B-Chat2026.04 | 75 | 68.9 | 11.9 | |
| AutoDANModel=Mistral-7B-Instruct-v0.22026.04 | 71.6 | 65.5 | 12.2 | |
| AutoDANModel=Qwen2.5-14B-Instruct2026.04 | 66.1 | 59.4 | 13.2 | |
| FITDModel=Yi-1.5-72B-Chat2026.04 | 47.2 | 41.5 | 15.1 | |
| FITDModel=Mistral-7B-Instruct-v0.22026.04 | 43.2 | 37.6 | 15.8 | |
| FITDModel=Qwen2.5-14B-Instruct2026.04 | 41 | 35.1 | 16.6 |