PII De-identification on canonical evaluation Platform A (test)
100PrecisionGemma 27B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Gemma 27BConfiguration Category=LLM-Only, Prompting=0-shot2026.06 | 100 | 56.4 | 72.1 | |
| Gemini 1.5 ProConfiguration Category=LLM-Only2026.06 | 96.2 | 77 | 85.5 | |
| Union + Gemma 27BConfiguration Category=Proposer + Reviewer2026.06 | 92.6 | 97.8 | 95.1 | |
| Gemma 27BConfiguration Category=LLM-Only, Tuning=LoRA2026.06 | 91.3 | 89.1 | 90.2 | |
| Gemma 4BConfiguration Category=LLM-Only, Prompting=0-shot2026.06 | 88 | 40 | 55 | |
| DeBERTaConfiguration Category=Proposer-Only2026.06 | 86.7 | 94.6 | 90.4 | |
| Union + Gemma 4BConfiguration Category=Proposer + Reviewer2026.06 | 85.9 | 99.4 | 92.1 | |
| Union + RoBERTaConfiguration Category=Proposer + Reviewer2026.06 | 84.1 | 96 | 89.6 | |
| Union (DeBERTa & ModernBERT)Configuration Category=Proposer-Only2026.06 | 71.4 | 97 | 82.3 | |
| PresidioConfiguration Category=Industry-Standard, Setting=default2026.06 | 15.3 | 82.4 | 25.8 | |
| spaCyConfiguration Category=Industry-Standard, Model=en_core_web_sm2026.06 | 3.1 | 77 | 6 |