PII De-identification on Ambiguous names (challenge set)
89.9Platform A PrecisionUnion + Gemma 31B
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Union + Gemma 31BConfiguration Category=Proposer + Reviewer2026.06 | 89.9 | 89.2 | 89.4 | 99.4 | 94.5 | 96.9 | 93.2 | |
| Gemini 3.1 ProConfiguration Category=LLM-Only2026.06 | 64.4 | 100 | 78.4 | 98.8 | 93.9 | 96.3 | 87.3 | |
| Gemma E4BConfiguration Category=LLM-Only2026.06 | 45.7 | 31.9 | 37.6 | 96 | 15.7 | 27 | 32.3 | |
| Union + RoBERTaConfiguration Category=Proposer + Reviewer2026.06 | 42.5 | 91.2 | 58 | 97.5 | 65.4 | 78.4 | 68.2 | |
| Union + Gemma E4BConfiguration Category=Proposer + Reviewer2026.06 | 41 | 97.4 | 57.7 | 87.2 | 99.1 | 92.8 | 75.3 | |
| DeBERTa-onlyConfiguration Category=Proposer-Only2026.06 | 40.8 | 96.6 | 57.4 | 98.5 | 87.1 | 92.5 | 75 | |
| Presidio (default)Configuration Category=Industry-Standard2026.06 | 9.9 | 76.1 | 17.5 | 36 | 88.3 | 51.2 | 34.8 | |
| spaCy (en_core_web_sm)Configuration Category=Industry-Standard2026.06 | 2.2 | 76.1 | 4.4 | 8 | 88.3 | 14.7 | 9.6 |