Indirect Prompt Injection Defense on HotpotQA
0.07Attack Success Rate (ASR)Encode_Base64
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Encode_Base64Model=Phi-3.5-mini-instruct (3.8B)2025.04 | 0.07 | 8.42 | 7.01 | |
| CachePruneModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 1.76 | 14.17 | 9.79 | |
| Encode_Base64Model=LLama3-8B2025.04 | 3.05 | 4.24 | 3.19 | |
| DatamarkingModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 3.24 | 12.74 | 9.78 | |
| CachePruneModel=Mistral-7B2025.04 | 5.51 | 14.38 | 13.32 | |
| DatamarkingModel=Mistral-7B2025.04 | 6.26 | 14.56 | 12.94 | |
| Encode_Base64Model=Mistral-7B2025.04 | 8.68 | 5.23 | 3.67 | |
| DelimitingModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 11.36 | 13.68 | 11.11 | |
| CachePruneModel=LLama3-8B2025.04 | 15.23 | 16.21 | 10.97 | |
| DelimitingModel=Mistral-7B2025.04 | 17.02 | 14.34 | 12.01 | |
| VanillaModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 21.67 | 14.14 | 7.69 | |
| SandwichModel=Mistral-7B2025.04 | 23.45 | 13.64 | 11.82 | |
| VanillaModel=Mistral-7B2025.04 | 25.6 | 14.1 | 10.12 | |
| DatamarkingModel=LLama3-8B2025.04 | 26.23 | 16.16 | 10.34 | |
| SandwichModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 40.17 | 12.56 | 5.17 | |
| SandwichModel=LLama3-8B2025.04 | 67.21 | 15.3 | 3.99 | |
| VanillaModel=LLama3-8B2025.04 | 69.01 | 16.24 | 5.12 | |
| DelimitingModel=LLama3-8B2025.04 | 77.24 | 17.06 | 6.34 |