PII detection on Reddit 150 samples (test)
86.18Span PrecisionLlama-3.1-8B (FT)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Llama-3.1-8B (FT)Fine-tuning=true2026.02 | 86.18 | 81.35 | 81.59 | 91.35 | 86.06 | 79.94 | 68.23 | 80.04 | |
| Llama-3.2-3B (FT)Fine-tuning=true2026.02 | 82.51 | 80.89 | 79.73 | 88.72 | 83.66 | 71.95 | 65.3 | 66.79 | |
| GPT-4.1-miniType=Proprietary baseline2026.02 | 75.86 | 91.28 | 81.07 | 90.98 | 89.28 | 68.96 | 59.24 | 69.23 | |
| Microsoft Presidio2026.02 | 71.62 | 50.05 | 56.25 | 83.6 | 67.11 | — | — | — | |
| Llama-3.2-3B (Ngong et al., 2025)Implementation=Ngong et al., 20252026.02 | 62.58 | 45.7 | 48.35 | 60.31 | — | 50.78 | 57.28 | 14.56 | |
| Llama-3.1-8B (Ngong et al., 2025)Implementation=Ngong et al., 20252026.02 | 49.02 | 71 | 55.72 | 58.16 | — | 60.72 | 54.633 | 51.61 | |
| Llama-3.1-8BFine-tuning=false2026.02 | 34.93 | 56.69 | 39.68 | 48.94 | 28.95 | 42.77 | 52.83 | 16.78 |