Indirect Prompt Injection Defense on Wildchat
0.33Attack Success Rate (ASR)CachePrune
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CachePruneModel=Mistral-7B2025.04 | 0.33 | 3.9 | |
| DelimitingModel=Mistral-7B2025.04 | 0.5 | 3.93 | |
| Encode_Base64Model=Mistral-7B2025.04 | 0.6 | 1.24 | |
| DatamarkingModel=Mistral-7B2025.04 | 1.5 | 3.91 | |
| CachePruneModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 1.89 | 3.6 | |
| CachePruneModel=LLama3-8B2025.04 | 2 | 3.32 | |
| VanillaModel=Mistral-7B2025.04 | 2 | 3.88 | |
| SandwichModel=Mistral-7B2025.04 | 2.5 | 3.85 | |
| DatamarkingModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 2.53 | 3.71 | |
| DelimitingModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 3.2 | 3.84 | |
| VanillaModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 3.32 | 3.78 | |
| Encode_Base64Model=Phi-3.5-mini-instruct (3.8B)2025.04 | 3.56 | 1.09 | |
| SandwichModel=Phi-3.5-mini-instruct (3.8B)2025.04 | 4.37 | 3.56 | |
| Encode_Base64Model=LLama3-8B2025.04 | 5.5 | 1.52 | |
| DatamarkingModel=LLama3-8B2025.04 | 7.5 | 2.98 | |
| SandwichModel=LLama3-8B2025.04 | 13.01 | 3.22 | |
| VanillaModel=LLama3-8B2025.04 | 14.5 | 3.32 | |
| DelimitingModel=LLama3-8B2025.04 | 16 | 3.12 |