Prompt Injection Attacks on OPEN-PROMPT-INJECTIONS
14.2Mean Attack Success Rate (ASR)Llama-3.3-70B-Instruct
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3.3-70B-InstructAttack=ignore2026.01 | 14.2 | 15.4 | -0.13 | 0.522 | |
| Llama-3.3-70B-InstructAttack=combine2026.01 | 16.5 | 17.4 | -0.107 | 0.607 | |
| Llama-3.3-70B-InstructAttack=naive2026.01 | 27.2 | 17.9 | — | — | |
| Llama-3.1-8B-InstructAttack=fake_completion2026.01 | 38 | 9.6 | -0.023 | 0.943 | |
| Llama-3.3-70B-InstructAttack=escape2026.01 | 38.8 | 16.9 | 0.116 | 1.426 | |
| Llama-3.3-70B-InstructAttack=fake_completion2026.01 | 39.8 | 14.2 | 0.126 | 1.463 | |
| Llama-3.1-8B-InstructAttack=naive2026.01 | 40.3 | 11.7 | — | — | |
| Llama-3.1-8B-InstructAttack=escape2026.01 | 46.7 | 11.3 | 0.064 | 1.159 | |
| Jamba-1.7-MiniAttack=naive2026.01 | 49 | 11.7 | — | — | |
| Llama-3.1-8B-InstructAttack=ignore2026.01 | 49.8 | 6.2 | 0.095 | 1.236 | |
| Llama-3.1-8B-InstructAttack=combine2026.01 | 51 | 7.3 | 0.107 | 1.265 | |
| Jamba-1.7-MiniAttack=escape2026.01 | 56.5 | 8.9 | 0.075 | 1.153 | |
| Jamba-1.7-MiniAttack=ignore2026.01 | 61.2 | 12.2 | 0.122 | 1.249 | |
| Jamba-1.7-MiniAttack=fake_completion2026.01 | 71.3 | 16 | 0.223 | 1.455 | |
| Jamba-1.7-MiniAttack=combine2026.01 | 74.3 | 16.5 | 0.253 | 1.516 |