PII De-identification on canonical evaluation Platform B (test)
99.3PrecisionGemma 27B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Gemma 27BConfiguration Category=LLM-Only, Prompting=0-shot2026.06 | 99.3 | 9.3 | 17 | |
| Gemini 1.5 ProConfiguration Category=LLM-Only2026.06 | 98.4 | 38.9 | 55.7 | |
| DeBERTaConfiguration Category=Proposer-Only2026.06 | 95.9 | 97.7 | 96.8 | |
| Union + Gemma 4BConfiguration Category=Proposer + Reviewer2026.06 | 95.6 | 97.2 | 96.4 | |
| Union + RoBERTaConfiguration Category=Proposer + Reviewer2026.06 | 95.3 | 97.7 | 96.5 | |
| Union + Gemma 27BConfiguration Category=Proposer + Reviewer2026.06 | 95.2 | 97.7 | 96.5 | |
| Gemma 27BConfiguration Category=LLM-Only, Tuning=LoRA2026.06 | 95.2 | 47.4 | 63.2 | |
| Gemma 4BConfiguration Category=LLM-Only, Prompting=0-shot2026.06 | 95 | 12 | 21.3 | |
| Union (DeBERTa & ModernBERT)Configuration Category=Proposer-Only2026.06 | 87.8 | 98.1 | 92.7 | |
| PresidioConfiguration Category=Industry-Standard, Setting=default2026.06 | 29.9 | 90.6 | 45 | |
| spaCyConfiguration Category=Industry-Standard, Model=en_core_web_sm2026.06 | 5.1 | 91.1 | 9.7 |