Agentic re-identification on 27 transcripts Gemini-3-Flash attacker
17Re-ID Success CountPresidio
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Presidio2026.05 | 17 | 63 | |
| One-shot w/ detailed promptPrompting Strategy=detailed prompt2026.05 | 14 | 51.9 | |
| One-shot w/ minimal promptPrompting Strategy=minimal prompt2026.05 | 8 | 29.6 | |
| AURA (8-attribute, GPT-4.1)Privacy Strategy=8-attribute, Base Model=GPT-4.12026.05 | 7 | 25.9 | |
| Anonymizer2026.05 | 7 | 25.9 | |
| AURA (8-attribute, Qwen3.5-35B-A3B)Privacy Strategy=8-attribute, Base Model=Qwen3.5-35B-A3B2026.05 | 4 | 14.8 | |
| DP-MLMDifferential Privacy Epsilon (ε)=1202026.05 | 4 | 14.8 | |
| DP-MLMDifferential Privacy Epsilon (ε)=1402026.05 | 4 | 14.8 | |
| AURA (8-attribute, Qwen3.5-27B)Privacy Strategy=8-attribute, Base Model=Qwen3.5-27B2026.05 | 3 | 11.1 | |
| AURA (adapt. privacy, Qwen3.5-35B-A3B)Privacy Strategy=adapt. privacy, Base Model=Qwen3.5-35B-A3B2026.05 | 2 | 7.4 | |
| AURA (pure adaptive, GPT-4.1)Privacy Strategy=pure adaptive, Base Model=GPT-4.12026.05 | 2 | 7.4 | |
| DP-MLMDifferential Privacy Epsilon (ε)=1002026.05 | 2 | 7.4 | |
| DP-MLMDifferential Privacy Epsilon (ε)=502026.05 | 1 | 3.7 | |
| DP-MLMDifferential Privacy Epsilon (ε)=702026.05 | 1 | 3.7 | |
| AURA (adapt. privacy, Qwen3.5-27B)Privacy Strategy=adapt. privacy, Base Model=Qwen3.5-27B2026.05 | 0 | 0 | |
| AURA (adapt. privacy, GPT-4.1)Privacy Strategy=adapt. privacy, Base Model=GPT-4.12026.05 | 0 | 0 | |
| DP-MLMDifferential Privacy Epsilon (ε)=102026.05 | 0 | 0 | |
| DP-MLMDifferential Privacy Epsilon (ε)=302026.05 | 0 | 0 |