Prompt Injection Defense on Indirect Prompt Injection Head 1.0
0.11ASR NaiveSegmentation removal method
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Segmentation removal methodModel=Llama3-8b-Instruct, Defense=Segment2025.02 | 0.11 | 0.11 | 0.11 | 7.44 | 0.11 | |
| Extraction removal methodModel=Llama3.1-8b-Instruct, Defense=Extraction2025.02 | 0.22 | 8.22 | 1.44 | 19.77 | 16 | |
| Extraction removal methodModel=Llama3-8b-Instruct, Defense=Extraction2025.02 | 0.33 | 6.77 | 1 | 12.66 | 13.88 | |
| Segmentation removal methodModel=Qwen2-7b-Instruct, Defense=Segment2025.02 | 0.33 | 0.11 | 0.22 | 14.11 | 0.11 | |
| StruQModel=Llama3.1-8b-Instruct, Defense=StruQ2025.02 | 0.44 | 2.33 | 0.22 | 0.22 | 1.77 | |
| Segmentation removal methodModel=Llama3.1-8b-Instruct, Defense=Segment2025.02 | 0.44 | 0.22 | 0.33 | 10.88 | 0.11 | |
| Extraction removal methodModel=Qwen2-7b-Instruct, Defense=Extraction2025.02 | 1.66 | 8.33 | 1.77 | 26.11 | 17.22 | |
| InstructionalModel=Llama3.1-8b-Instruct, Defense=Instructional2025.02 | 2.22 | 12 | 6 | 8.11 | 18.33 | |
| SandwichModel=Llama3.1-8b-Instruct, Defense=Sandwich2025.02 | 2.77 | 8.22 | 8.22 | 12.44 | 11.33 | |
| StruQModel=Llama3-8b-Instruct, Defense=StruQ2025.02 | 3.33 | 3.44 | 0.77 | 0.77 | 1.77 | |
| StruQModel=Qwen2-7b-Instruct, Defense=StruQ2025.02 | 3.55 | 0.55 | 1.66 | 9.11 | 12.77 | |
| NoneModel=Llama3.1-8b-Instruct, Defense=None2025.02 | 4 | 45.11 | 14 | 50.22 | 63.77 | |
| NoneModel=Llama3-8b-Instruct, Defense=None2025.02 | 4.11 | 38.77 | 12.66 | 33.33 | 54.44 | |
| InstructionalModel=Llama3-8b-Instruct, Defense=Instructional2025.02 | 4.44 | 18.44 | 10.44 | 6 | 23.11 | |
| SandwichModel=Llama3-8b-Instruct, Defense=Sandwich2025.02 | 5.33 | 8.66 | 12.55 | 11.77 | 11.55 | |
| SandwichModel=Qwen2-7b-Instruct, Defense=Sandwich2025.02 | 19 | 19.77 | 19.33 | 15.22 | 13.66 | |
| InstructionalModel=Qwen2-7b-Instruct, Defense=Instructional2025.02 | 24.44 | 28.22 | 24.55 | 46.55 | 34.11 | |
| NoneModel=Qwen2-7b-Instruct, Defense=None2025.02 | 26.77 | 42.11 | 27.88 | 63.44 | 59.55 |