Jailbreaking on MaliciousInstruct (test)
4.63BERT ScoreJULI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| JULITarget Model=Llama3-3B-INST2025.05 | 4.63 | 4.61 | 3.78 | |
| EDTarget Model=Llama3-3B-INST2025.05 | 4.33 | 4.63 | 4.23 | |
| FLIPTarget Model=Llama3-3B-INST2025.05 | 4.11 | 2.07 | 0.76 | |
| FLIPTarget Model=Llama3-8B-INST2025.05 | 4.09 | 2.51 | 0.85 | |
| EDTarget Model=Llama3-8B-INST2025.05 | 3.99 | 4.05 | 3.27 | |
| JULITarget Model=Qwen2.5-1.5B2025.05 | 3.97 | 4.46 | 3.55 | |
| EDTarget Model=Llama2-7B-CHAT2025.05 | 3.85 | 3.89 | 2.68 | |
| WTSTarget Model=Qwen2.5-1.5B2025.05 | 3.79 | 4.42 | 3.19 | |
| JULITarget Model=Llama2-7B-CHAT2025.05 | 3.68 | 3.92 | 3.38 | |
| JULITarget Model=Llama3-8B-INST2025.05 | 3.66 | 4.55 | 3.13 | |
| EDTarget Model=Qwen2.5-1.5B2025.05 | 3.48 | 1.25 | 0.66 | |
| FLIPTarget Model=Qwen2.5-1.5B2025.05 | 3.33 | 2.09 | 0.73 | |
| GCGTarget Model=Qwen2.5-1.5B2025.05 | 2.99 | 2.37 | 1.81 | |
| LINTTarget Model=Qwen2.5-1.5B2025.05 | 2.86 | 4.24 | 3.03 | |
| BaseTarget Model=Qwen2.5-1.5B2025.05 | 2.82 | 2.01 | 1.09 | |
| NaiveTarget Model=Qwen2.5-1.5B2025.05 | 2.77 | 1.46 | 0.52 | |
| NaiveTarget Model=Llama3-3B-INST2025.05 | 2.41 | 1.52 | 0.46 | |
| WTSTarget Model=Llama3-8B-INST2025.05 | 2.33 | 2.22 | 1.1 | |
| LINTTarget Model=Llama2-7B-CHAT2025.05 | 2.3 | 3.66 | 1.98 | |
| LINTTarget Model=Llama3-3B-INST2025.05 | 2.21 | 4.11 | 2.75 | |
| WTSTarget Model=Llama3-3B-INST2025.05 | 2.15 | 2.01 | 0.92 | |
| GCGTarget Model=Llama3-3B-INST2025.05 | 2.11 | 2.28 | 1.61 | |
| FLIPTarget Model=Llama2-7B-CHAT2025.05 | 1.93 | 1.04 | 0.03 | |
| LINTTarget Model=Llama3-8B-INST2025.05 | 1.7 | 3.89 | 2.34 | |
| BaseTarget Model=Llama3-8B-INST2025.05 | 1.68 | 1.31 | 0.29 | |
| GCGTarget Model=Llama3-8B-INST2025.05 | 1.65 | 1.24 | 0.26 | |
| BaseTarget Model=Llama3-3B-INST2025.05 | 1.53 | 1.31 | 0.49 | |
| WTSTarget Model=Llama2-7B-CHAT2025.05 | 1.51 | 1.34 | 0.33 | |
| GCGTarget Model=Llama2-7B-CHAT2025.05 | 1.42 | 1.31 | 0.28 | |
| NaiveTarget Model=Llama2-7B-CHAT2025.05 | 1.28 | 1.5 | 0.68 | |
| NaiveTarget Model=Llama3-8B-INST2025.05 | 1.14 | 1.43 | 0.23 | |
| BaseTarget Model=Llama2-7B-CHAT2025.05 | 1.14 | 1.19 | 0.24 |