Jailbreak Attack on Advbench Vicuna-33B Guard 100 prompts Original
0ASRNo Attack
Evaluation Results
| Method | Links | |
|---|---|---|
| No AttackLLM Model=Llama2-70B, Attack Version=Original2024.02 | 0 | |
| GCGLLM Model=Llama2-70B, Attack Version=Original2024.02 | 0 | |
| GCG + PRPLLM Model=Llama2-70B, Attack Version=PRP-W, Access Threat Model=white-box2024.02 | 1 | |
| GCG + PRPLLM Model=Llama2-70B, Attack Version=PRP-B, Access Threat Model=black-box2024.02 | 2 | |
| No AttackLLM Model=Guanaco-13B, Attack Version=Original2024.02 | 2 | |
| No AttackLLM Model=Vicuna-33B, Attack Version=Original2024.02 | 7 | |
| GCGLLM Model=Vicuna-33B, Attack Version=Original2024.02 | 14 | |
| GCGLLM Model=Guanaco-13B, Attack Version=Original2024.02 | 14 | |
| PAPLLM Model=Guanaco-13B, Attack Version=Original2024.02 | 33 | |
| PAPLLM Model=Llama2-70B, Attack Version=Original2024.02 | 44 | |
| PAPLLM Model=Vicuna-33B, Attack Version=Original2024.02 | 52 | |
| GCG + PRPLLM Model=Vicuna-33B, Attack Version=PRP-W, Access Threat Model=white-box2024.02 | 61 | |
| PAP + PRPLLM Model=Guanaco-13B, Attack Version=PRP-W, Access Threat Model=white-box2024.02 | 70 | |
| GCG + PRPLLM Model=Vicuna-33B, Attack Version=PRP-B, Access Threat Model=black-box2024.02 | 73 | |
| PAP + PRPLLM Model=Llama2-70B, Attack Version=PRP-B, Access Threat Model=black-box2024.02 | 74 | |
| PAP + PRPLLM Model=Guanaco-13B, Attack Version=PRP-B, Access Threat Model=black-box2024.02 | 74 | |
| PAP + PRPLLM Model=Llama2-70B, Attack Version=PRP-W, Access Threat Model=white-box2024.02 | 76 | |
| GCG + PRPLLM Model=Guanaco-13B, Attack Version=PRP-W, Access Threat Model=white-box2024.02 | 83 | |
| PAP + PRPLLM Model=Vicuna-33B, Attack Version=PRP-W, Access Threat Model=white-box2024.02 | 84 | |
| PAP + PRPLLM Model=Vicuna-33B, Attack Version=PRP-B, Access Threat Model=black-box2024.02 | 90 | |
| GCG + PRPLLM Model=Guanaco-13B, Attack Version=PRP-B, Access Threat Model=black-box2024.02 | 91 |