Prompt Leaking Defense on LeakBench
7.09PLSOnly Local Lookup
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Only Local LookupVictim LLM=Llama-3.1-8B-Instruct2026.06 | 7.09 | 75 | 7.59 | 6.66 | |
| Only Local LookupVictim LLM=Mistral-7B-Instruct2026.06 | 6.39 | 66 | 7.09 | 7.05 | |
| Fake PromptVictim LLM=Llama-3.1-8B-Instruct2026.06 | 6.2 | 72 | 7.21 | 6.59 | |
| Only Local LookupVictim LLM=Llama-2-7B-chat-hf2026.06 | 6.08 | 69 | 7.63 | 6.81 | |
| Random InsertionVictim LLM=Llama-3.1-8B-Instruct2026.06 | 6.02 | 72 | 7.13 | 6.88 | |
| PromptKeeperVictim LLM=Llama-3.1-8B-Instruct2026.06 | 5.85 | 57 | 5.57 | 5.82 | |
| Repeated Prefix of PromptsVictim LLM=Mistral-7B-Instruct2026.06 | 5.67 | 64 | 6.26 | 7.09 | |
| Repeated Prefix of PromptsVictim LLM=Llama-2-7B-chat-hf2026.06 | 5.66 | 64 | 7.4 | 7.27 | |
| Repeated Prefix of PromptsVictim LLM=Llama-3.1-8B-Instruct2026.06 | 5.63 | 61 | 7.42 | 7.03 | |
| Fake PromptVictim LLM=Llama-2-7B-chat-hf2026.06 | 5.51 | 66 | 7.11 | 6.63 | |
| Random InsertionVictim LLM=Mistral-7B-Instruct2026.06 | 5.4 | 69 | 6 | 6.76 | |
| Random InsertionVictim LLM=Llama-2-7B-chat-hf2026.06 | 5.37 | 69 | 7.24 | 7.01 | |
| Fake PromptVictim LLM=Mistral-7B-Instruct2026.06 | 5.25 | 65 | 6.3 | 6.75 | |
| PromptKeeperVictim LLM=Llama-2-7B-chat-hf2026.06 | 2.58 | 36 | 3.99 | 4.92 | |
| PromptKeeperVictim LLM=Mistral-7B-Instruct2026.06 | 2.53 | 31 | 4.45 | 4.73 | |
| SysVecVictim LLM=Mistral-7B-Instruct2026.06 | 1.95 | 31 | 4.13 | 5.12 | |
| PromptObfuscationVictim LLM=Llama-2-7B-chat-hf2026.06 | 1.14 | 33 | 4.34 | 4.49 | |
| PromptObfuscationVictim LLM=Llama-3.1-8B-Instruct2026.06 | 1.12 | 16 | 5.34 | 5.16 | |
| SysVecVictim LLM=Llama-3.1-8B-Instruct2026.06 | 1.11 | 14 | 4.36 | 5.58 | |
| SysVecVictim LLM=Llama-2-7B-chat-hf2026.06 | 1.08 | 24 | 3.98 | 5.03 |