Agentic re-identification on 27 transcripts GPT-5.4-mini attacker
77.7778Re-ID Success Rate (Derived)Presidio
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Presidio2026.05 | 77.7778 | 77.8 | |
| One-shot w/ detailed promptPrompting Strategy=detailed prompt2026.05 | 62.963 | 63 | |
| One-shot w/ minimal promptPrompting Strategy=minimal prompt2026.05 | 51.8519 | 51.9 | |
| AURA (8-attribute, GPT-4.1)Privacy Strategy=8-attribute, Base Model=GPT-4.12026.05 | 29.6296 | 29.6 | |
| AURA (8-attribute, Qwen3.5-35B-A3B)Privacy Strategy=8-attribute, Base Model=Qwen3.5-35B-A3B2026.05 | 29.6296 | 29.6 | |
| AURA (8-attribute, Qwen3.5-27B)Privacy Strategy=8-attribute, Base Model=Qwen3.5-27B2026.05 | 25.9259 | 25.9 | |
| Anonymizer2026.05 | 25.9259 | 25.9 | |
| AURA (adapt. privacy, Qwen3.5-35B-A3B)Privacy Strategy=adapt. privacy, Base Model=Qwen3.5-35B-A3B2026.05 | 18.5185 | 18.5 | |
| DP-MLMDifferential Privacy Epsilon (ε)=1002026.05 | 18.5185 | 18.5 | |
| AURA (adapt. privacy, Qwen3.5-27B)Privacy Strategy=adapt. privacy, Base Model=Qwen3.5-27B2026.05 | 14.8148 | 14.8 | |
| DP-MLMDifferential Privacy Epsilon (ε)=502026.05 | 14.8148 | 14.8 | |
| DP-MLMDifferential Privacy Epsilon (ε)=1202026.05 | 14.8148 | 14.8 | |
| DP-MLMDifferential Privacy Epsilon (ε)=1402026.05 | 14.8148 | 14.8 | |
| AURA (adapt. privacy, GPT-4.1)Privacy Strategy=adapt. privacy, Base Model=GPT-4.12026.05 | 11.1111 | 11.1 | |
| AURA (pure adaptive, GPT-4.1)Privacy Strategy=pure adaptive, Base Model=GPT-4.12026.05 | 11.1111 | 11.1 | |
| DP-MLMDifferential Privacy Epsilon (ε)=702026.05 | 11.1111 | 11.1 | |
| DP-MLMDifferential Privacy Epsilon (ε)=102026.05 | 0 | 0 | |
| DP-MLMDifferential Privacy Epsilon (ε)=302026.05 | 0 | 0 |