Personal Information Extraction on Professor
98Email Address Accuracygpt-4
Evaluation Results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gpt-42024.08 | 98 | 98 | 87 | 87 | 96 | 99 | 99 | 70 | 61 | 78 | 67 | 86 | 78 | 83 | 80 | |
| gemini-pro2024.08 | 91 | 91 | 94 | 94 | 65 | 83 | 83 | 45 | 24 | 60 | 34 | 70 | 46 | 76 | 61 | |
| text-bison-0012024.08 | 83 | 83 | 81 | 81 | 65 | 78 | 78 | 45 | 32 | 57 | 38 | 63 | 51 | 78 | 58 | |
| gpt-3.5-turbo2024.08 | 81 | 81 | 72 | 72 | 86 | 84 | 84 | 55 | 49 | 66 | 55 | 80 | 68 | 72 | 58 | |
| flan-ul22024.08 | 81 | 81 | 96 | 96 | 42 | 100 | 100 | 19 | 6 | 17 | 10 | 82 | 79 | 67 | 58 | |
| internlm-chat-7bparameter count=7B, type=chat2024.08 | 72 | 72 | 61 | 61 | 88 | 94 | 94 | 39 | 3 | 35 | 14 | 73 | 70 | 72 | 65 | |
| vicuna-13b-v1.3parameter count=13B, version=v1.32024.08 | 71 | 71 | 60 | 60 | 76 | 87 | 87 | 47 | 41 | 46 | 37 | 71 | 56 | 63 | 58 | |
| chat-bison-0012024.08 | 67 | 67 | 74 | 74 | 72 | 83 | 83 | 33 | 18 | 52 | 32 | 0.61 | — | 72 | 67 | |
| vicuna-7b-v1.3parameter count=7B, version=v1.32024.08 | 65 | 65 | 46 | 46 | 82 | 88 | 88 | 40 | 24 | 26 | 18 | 75 | 64 | 63 | 61 | |
| llama-2-7b-chat-hfparameter count=7B, type=chat2024.08 | 33 | 33 | 45 | 45 | 53 | 35 | 35 | 22 | 4 | 25 | 18 | 53 | 32 | 35 | 27 |