PII Detection on Crash narratives dataset
100PrecisionPresidio
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PresidioPII Category=Email2026.04 | 100 | 100 | 100 | — | |
| Llama3.1-8B promptingPII Category=Alphanumeric2026.04 | 100 | 5 | 10 | — | |
| Gemma-27B prompting(few shot)PII Category=Email2026.04 | 100 | 100 | 100 | — | |
| Fine-tuned LLM (Llama3.1-8B)PII Category=Email2026.04 | 100 | 33 | 50 | — | |
| Agentic WorkflowPII Category=Email2026.04 | 100 | 100 | 100 | — | |
| Agentic WorkflowPII Category=Home address2026.04 | 100 | 64 | 78 | — | |
| Gemma-27B prompting(few shot)PII Category=Name2026.04 | 98 | 45 | 61 | — | |
| Fine-tuned LLM (Llama3.1-8B)PII Category=Name2026.04 | 94 | 70 | 80 | — | |
| Agentic WorkflowPII Category=Name2026.04 | 93 | 76 | 84 | — | |
| Fine-tuned LLM (Llama3.1-8B)PII Category=Overall2026.04 | 91 | 86 | 88 | 97 | |
| PresidioPII Category=Phone Number2026.04 | 88 | 94 | 91 | — | |
| Gemma-27B prompting(few shot)PII Category=Phone Number2026.04 | 88 | 94 | 91 | — | |
| Agentic WorkflowPII Category=Phone Number2026.04 | 88 | 94 | 91 | — | |
| Agentic WorkflowPII Category=Overall2026.04 | 82 | 94 | 87 | 96 | |
| Gemma-27B prompting(few shot)PII Category=Overall2026.04 | 78 | 65 | 71 | 93 | |
| Gemma-27B prompting(few shot)PII Category=Home address2026.04 | 61 | 89 | 72 | — | |
| Fine-tuned LLM (Llama3.1-8B)PII Category=Home address2026.04 | 56 | 56 | 56 | — | |
| Fine-tuned LLM (Llama3.1-8B)PII Category=Phone Number2026.04 | 54 | 44 | 48 | — | |
| Agentic WorkflowPII Category=Alphanumeric2026.04 | 54 | 75 | 63 | — | |
| PresidioPII Category=Name2026.04 | 51 | 68 | 58 | — | |
| Llama3.1-8B promptingPII Category=Email2026.04 | 50 | 33 | 40 | — | |
| Llama3.1-8B promptingPII Category=Home address2026.04 | 50 | 11 | 18 | — | |
| Fine-tuned LLM (Llama3.1-8B)PII Category=Alphanumeric2026.04 | 48 | 61 | 54 | — | |
| Llama3.1-8B promptingPII Category=Overall2026.04 | 41 | 83 | 55 | 81 | |
| Llama3.1-8B promptingPII Category=Name2026.04 | 40 | 58 | 47 | — | |
| PresidioPII Category=Overall2026.04 | 38 | 93 | 54 | 78 | |
| Gemma-27B prompting(few shot)PII Category=Alphanumeric2026.04 | 34 | 89 | 49 | — | |
| PresidioPII Category=Alphanumeric2026.04 | 8 | 39 | 14 | — | |
| Llama3.1-8B promptingPII Category=Phone Number2026.04 | 0 | 0 | 0 | — |