PII Detection on PII-Single v1 (test)
92.1Entity F1 ScoreDeepSeekV3
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeekV3Model Category=API-based Large Language Model2025.02 | 92.1 | 90.3 | 90.5 | |
| GPT4oModel Category=API-based Large Language Model2025.02 | 91.4 | 89.3 | 89.5 | |
| Llama3.1Model Category=Open-source Large Language Model2025.02 | 91.3 | 88.1 | 88.3 | |
| Qwen2.5Model Category=Open-source Large Language Model2025.02 | 90.8 | 86.6 | 86.9 | |
| Claude3.5Model Category=API-based Large Language Model2025.02 | 89.1 | 85.8 | 86.2 | |
| BiLSTM-CRFModel Category=Traditional Model2025.02 | 85.1 | — | — | |
| Qwen2.5-SLMModel Category=Open-source Small Language Model2025.02 | 84.6 | 78.7 | 79.2 | |
| Llama3.1-SLMModel Category=Open-source Small Language Model2025.02 | 80 | 74.8 | 75.2 |