Prompt Injection Prevention on NQ simplified
41Naïve Success RateNone
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| NoneModel=Mistral-7B2026.02 | 41 | 53 | 39 | 61 | 67 | 48 | |
| NoneModel=Qwen-2.5-7B2026.02 | 39 | 58 | 43 | 60 | 65 | 40 | |
| NoneModel=Llama-3-8B2026.02 | 37 | 56 | 39 | 59 | 63 | 42 | |
| SandwichModel=Mistral-7B2026.02 | 36 | 41 | 34 | 51 | 54 | 40 | |
| SandwichModel=Llama-3-8B2026.02 | 30 | 45 | 31 | 47 | 53 | 38 | |
| PromptArmorModel=Llama-3-8B2026.02 | 28 | 38 | 26 | 52 | 55 | 34 | |
| SandwichModel=Qwen-2.5-7B2026.02 | 28 | 47 | 31 | 48 | 55 | 33 | |
| PromptArmorModel=Mistral-7B2026.02 | 26 | 36 | 26 | 43 | 49 | 30 | |
| PromptArmorModel=Qwen-2.5-7B2026.02 | 25 | 33 | 27 | 48 | 53 | 27 | |
| DataFilterModel=Mistral-7B2026.02 | 15 | 18 | 17 | 22 | 23 | 18 | |
| DataFilterModel=Qwen-2.5-7B2026.02 | 12 | 16 | 14 | 21 | 24 | 14 | |
| DataFilterModel=Llama-3-8B2026.02 | 10 | 13 | 11 | 22 | 25 | 12 | |
| StruQModel=Llama-3-8B2026.02 | 3 | 5 | 4 | 8 | 10 | 36 | |
| StruQModel=Mistral-7B2026.02 | 3 | 5 | 5 | 9 | 12 | 42 | |
| SecAlignModel=Mistral-7B2026.02 | 3 | 6 | 4 | 7 | 13 | 33 | |
| SecAlignModel=Qwen-2.5-7B2026.02 | 3 | 4 | 3 | 8 | 13 | 27 | |
| SecAlignModel=Llama-3-8B2026.02 | 2 | 3 | 4 | 10 | 11 | 27 | |
| StruQModel=Qwen-2.5-7B2026.02 | 2 | 5 | 3 | 13 | 18 | 31 | |
| PromptLocateModel=Llama-3-8B2026.02 | 0 | 0 | 0 | 6 | 8 | 3 | |
| RedVisorModel=Llama-3-8B2026.02 | 0 | 0 | 0 | 1 | 4 | 0 | |
| PromptLocateModel=Mistral-7B2026.02 | 0 | 0 | 0 | 9 | 11 | 0 | |
| RedVisorModel=Mistral-7B2026.02 | 0 | 0 | 0 | 6 | 8 | 0 | |
| PromptLocateModel=Qwen-2.5-7B2026.02 | 0 | 0 | 0 | 7 | 10 | 0 | |
| RedVisorModel=Qwen-2.5-7B2026.02 | 0 | 0 | 0 | 3 | 7 | 0 |