Prompt Injection Attack on SQuAD
10.32Attack Success Rate (ASR)Vanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaModel=Phi3.5-mini-instruct, Attack Type=Adaptive, Attack Tokens (K)=10, Epochs (E)=202025.04 | 10.32 | 26.13 | |
| DelimitingModel=Phi3.5-mini-instruct, Attack Type=Adaptive, Attack Tokens (K)=10, Epochs (E)=202025.04 | 9.09 | 25.01 | |
| DaramarkingModel=Phi3.5-mini-instruct, Attack Type=Adaptive, Attack Tokens (K)=10, Epochs (E)=202025.04 | 5.53 | 26.67 | |
| CachePruneModel=Phi3.5-mini-instruct, Attack Type=Adaptive, Attack Tokens (K)=10, Epochs (E)=20, N=82025.04 | 1.55 | 25.98 |