Personal Information Extraction on Court
57Email Rouge-1gpt-3.5-turbo
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gpt-3.5-turbo2024.08 | 57 | — | 0.43 | — | — | 88 | 0.68 | 42 | 0.22 | — | — | — | — | — | — | |
| gemini-pro2024.08 | 54 | — | 0.43 | — | — | 84 | 0.64 | 25 | 0.03 | — | — | — | — | — | — | |
| gpt-42024.08 | 48 | — | 0.38 | — | — | 92 | 0.91 | 66 | 0.57 | — | — | — | — | — | — | |
| text-bison-0012024.08 | 45 | — | 0.36 | — | — | 85 | 0.56 | 23 | 0.12 | — | — | — | — | — | — | |
| flan-ul22024.08 | 41 | — | 0.26 | — | — | 45 | 0.24 | 25 | 0.03 | — | — | — | — | — | — | |
| vicuna-7b-v1.3parameter count=7B, version=v1.32024.08 | 14 | — | 0.02 | — | — | 23 | 0.14 | 25 | 0 | — | — | — | — | — | — | |
| chat-bison-0012024.08 | 6 | — | 0.02 | — | — | 91 | 0.87 | 14 | 0.11 | — | — | — | — | — | — | |
| llama-2-7b-chat-hfparameter count=7B, type=chat2024.08 | 4 | — | 0 | — | — | 11 | 0 | 15 | 0 | — | — | — | — | — | — | |
| internlm-chat-7bparameter count=7B, type=chat2024.08 | 2 | — | 0 | — | — | 36 | 0 | 4 | 0 | — | — | — | — | — | — | |
| vicuna-13b-v1.3parameter count=13B, version=v1.32024.08 | 1 | — | 0 | — | — | 25 | 0.13 | 2 | 0 | — | — | — | — | — | — |