PII Detection on PII-Real
92.3Strict F1DeepSeekV3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeekV3Model Type=API-based Large Language Model2025.02 | 92.3 | 94.1 | 92.5 | |
| GPT4oModel Type=API-based Large Language Model2025.02 | 91.2 | 93.4 | 91.4 | |
| Llama3.1Model Type=Open-source Large Language Model2025.02 | 90.1 | 92.8 | 90.3 | |
| Claude3.5Model Type=API-based Large Language Model2025.02 | 88.7 | 91.1 | 88.9 | |
| Qwen2.5Model Type=Open-source Large Language Model2025.02 | 88.4 | 91.9 | 88.7 | |
| Qwen2.5-SLMModel Type=Open-source Small Language Model2025.02 | 79.8 | 85.6 | 80.3 | |
| Llama3.1-SLMModel Type=Open-source Small Language Model2025.02 | 76.2 | 81.3 | 76.6 |