PII De-identification on canonical evaluation Combined (test)
95.8Macro F1Union + Gemma 27B
Evaluation Results
| Method | Links | |
|---|---|---|
| Union + Gemma 27BConfiguration Category=Proposer + Reviewer2026.06 | 95.8 | |
| Union + Gemma 4BConfiguration Category=Proposer + Reviewer2026.06 | 94.3 | |
| DeBERTaConfiguration Category=Proposer-Only2026.06 | 93.6 | |
| Union + RoBERTaConfiguration Category=Proposer + Reviewer2026.06 | 93.1 | |
| Union (DeBERTa & ModernBERT)Configuration Category=Proposer-Only2026.06 | 87.5 | |
| Gemma 27BConfiguration Category=LLM-Only, Tuning=LoRA2026.06 | 76.7 | |
| Gemini 1.5 ProConfiguration Category=LLM-Only2026.06 | 70.6 | |
| Gemma 27BConfiguration Category=LLM-Only, Prompting=0-shot2026.06 | 44.6 | |
| Gemma 4BConfiguration Category=LLM-Only, Prompting=0-shot2026.06 | 38.1 | |
| PresidioConfiguration Category=Industry-Standard, Setting=default2026.06 | 35.4 | |
| spaCyConfiguration Category=Industry-Standard, Model=en_core_web_sm2026.06 | 7.8 |