Jailbreak Prompt Quality Evaluation on 500 randomly sampled prompts
81SimilarityPAIR
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| PAIRBackbone=Mistral2026.05 | 81 | 43.66 | — | 31 | — | 7 | 74 | 74 | |
| GCGBackbone=Mistral2026.05 | 80 | 32.98 | 25 | 30 | 40 | 10 | 92 | 54 | |
| GCGTarget Model=Llama32026.05 | 65 | 21.22 | 24 | 33 | 43 | 13 | 98 | 78 | |
| PAIRTarget Model=Llama32026.05 | 64 | 39.35 | — | — | 40 | 8 | 66 | 56 | |
| SAATarget Model=Llama32026.05 | 50 | 38.4 | 26 | 32 | 41 | 19 | 100 | 100 | |
| SAABackbone=Mistral2026.05 | 49 | 29.23 | 23 | 32 | — | 15 | 100 | 100 | |
| PuzzlerTarget Model=Llama32026.05 | 40 | 33.37 | 25 | 33 | 41 | 15 | 100 | 100 | |
| PuzzlerBackbone=Mistral2026.05 | 40 | 33.37 | 25 | 33 | 41 | 15 | 100 | 100 | |
| DrAttackBackbone=Mistral2026.05 | 36 | 17.53 | 24 | 33 | 40 | 16 | 88 | 96 | |
| DrAttackTarget Model=Llama32026.05 | 33 | 19.13 | 24 | 33 | 41 | 14 | 70 | 54 | |
| IJPTarget Model=Llama32026.05 | 16 | 20.87 | 22 | — | — | — | 100 | 100 | |
| ZULUBackbone=Mistral2026.05 | 16 | 1,052.22 | 28 | 34 | 44 | 4 | 100 | 96 | |
| ZULUTarget Model=Llama32026.05 | 14 | 1,155.85 | — | — | 44 | 4 | 100 | 98 | |
| IJPBackbone=Mistral2026.05 | 12 | 53.65 | — | — | — | 3 | 100 | 100 | |
| Base64Target Model=Llama32026.05 | 11 | 87.43 | — | — | — | 3 | 100 | 100 | |
| Base64Backbone=Mistral2026.05 | 11 | 89.54 | — | — | — | 3 | 100 | 100 |