Personal Information Extraction on Synthetic Personal Profile Dataset
54Accuracy (Email)Prompt Injection Defense
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Prompt Injection DefenseLLM=flan-ul22024.08 | 54 | 54 | 36 | 36 | 6 | 6 | 69 | 53 | 16 | 9 | 28 | 15 | 44 | 32 | 11 | 8 | |
| Prompt Injection DefenseLLM=gpt-3.5-turbo2024.08 | 5 | 5 | 4 | 4 | 1 | 1 | 8 | 8 | 32 | 27 | 56 | 43 | 1 | 0 | 1 | 1 | |
| Prompt Injection DefenseLLM=internlm-chat-7b2024.08 | 5 | 5 | 1 | 1 | 5 | 5 | 4 | 4 | 5 | 4 | 8 | 7 | 3 | 9 | 0 | 2 | |
| Prompt Injection DefenseLLM=vicuna-7b-v1.32024.08 | 3 | 3 | 11 | 11 | 16 | 15 | 0 | 0 | 12 | 5 | 8 | 7 | 2 | 2 | 1 | 1 | |
| Prompt Injection DefenseLLM=gemini-pro2024.08 | 1 | 1 | 3 | 3 | 1 | 1 | 0 | 0 | 4 | 4 | 1 | 1 | 0 | 1 | 1 | 4 | |
| Prompt Injection DefenseLLM=llama-2-7b-chat-hf2024.08 | 1 | 1 | 8 | 8 | 4 | 3 | 17 | 17 | 3 | 2 | 2 | 0 | 7 | 6 | 2 | 1 | |
| Prompt Injection DefenseLLM=text-bison-0012024.08 | 0 | 0 | 1 | 1 | 0 | 0 | 2 | 2 | 26 | 20 | 33 | 25 | 0 | 0 | 0 | 0 | |
| Prompt Injection DefenseLLM=chat-bison-0012024.08 | 0 | 0 | 50 | 50 | 0 | 0 | 12 | 12 | 12 | 7 | 7 | 7 | 0 | 0 | 0 | 0 | |
| Prompt Injection DefenseLLM=gpt-42024.08 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Prompt Injection DefenseLLM=vicuna-13b-v1.32024.08 | 0 | 0 | 22 | 22 | 5 | 5 | 1 | 1 | 0 | 0 | 3 | 3 | 0 | 0 | 1 | 1 |