Personal Information Extraction on Celebrity
100Email Address Accuracygpt-4
Evaluation Results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gpt-42024.08 | 100 | 100 | 100 | 100 | 100 | 84 | 83 | 39 | 23 | 41 | 31 | 78 | 77 | 84 | 84 | |
| gpt-3.5-turbo2024.08 | 100 | 100 | 100 | 100 | 100 | 82 | 82 | 40 | 23 | 37 | 24 | 89 | 89 | 88 | 87 | |
| gemini-pro2024.08 | 100 | 100 | 100 | 100 | 100 | 73 | 73 | 22 | 6 | 32 | 20 | 92 | 92 | 89 | 88 | |
| flan-ul22024.08 | 99 | 99 | 99 | 99 | 97 | 87 | 87 | 3 | 1 | 18 | 9 | 54 | 54 | 32 | 32 | |
| text-bison-0012024.08 | 92 | 92 | 100 | 100 | 97 | 87 | 87 | 18 | 8 | 29 | 20 | 85 | 85 | 77 | 76 | |
| vicuna-7b-v1.3parameter count=7B, version=v1.32024.08 | 80 | 80 | 99 | 99 | 27 | 86 | 86 | 35 | 18 | 25 | 6 | 30 | 29 | 17 | 16 | |
| llama-2-7b-chat-hfparameter count=7B, type=chat2024.08 | 59 | 59 | 82 | 82 | 54 | 61 | 61 | 31 | 13 | 26 | 10 | 56 | 55 | 27 | 26 | |
| chat-bison-0012024.08 | 41 | 41 | 76 | 76 | 34 | 80 | 80 | 25 | 5 | 18 | 2 | 51 | 50 | 34 | 33 | |
| internlm-chat-7bparameter count=7B, type=chat2024.08 | 34 | 34 | 80 | 80 | 37 | 75 | 75 | 25 | 10 | 17 | 4 | 29 | 28 | 23 | 22 | |
| vicuna-13b-v1.3parameter count=13B, version=v1.32024.08 | 21 | 21 | 99 | 99 | 71 | 85 | 85 | 32 | 16 | 27 | 11 | 22 | 21 | 13 | 11 |