Text Anonymization on SynthPAI
64PrivacyAF
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AFBackbone=GPT-52026.02 | 64 | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.6 | — | |
| Original2026.01 | 60.7 | 38.7 | 69 | 94.3 | 74.5 | 32.8 | 83.3 | 70.7 | 33.3 | 100 | 100 | 100 | 100 | 100 | 100 | — | |
| Dipper2026.01 | 57.9 | 38.5 | 68.8 | 85.4 | 63.2 | 36.2 | 76.6 | 70.4 | 42.9 | 85.4 | 82.7 | 83.4 | 13 | 61.7 | 52.8 | -0.426 | |
| Azure2026.01 | 49.9 | 34.2 | 56.3 | 82.9 | 65.8 | 10.3 | 66 | 63.4 | 0 | 72.7 | 29.1 | 100 | 79.8 | 95.2 | 80.7 | -0.015 | |
| RUPTA2026.01 | 47.4 | 33.3 | 46.9 | 70.7 | 63.2 | 13.8 | 59.6 | 63.4 | 14.3 | 92 | 86.2 | 96.1 | 71.2 | 91.2 | 84.6 | 0.065 | |
| INTENTANONYlabel=Ours2026.01 | 41 | 33.3 | 37.5 | 78 | 60.5 | 13.8 | 48.9 | 33.8 | 0 | 98.1 | 94.6 | 99.8 | 84.9 | 94.4 | 92.3 | 0.247 | |
| AFBackbone Model=Gemma-3-27b-it2026.02 | 40.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | 60.2 | — | |
| Optimized PromptBackbone Model=Mistral-Small-3.2-24B2026.02 | 38.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.4 | — | |
| Seed PromptBackbone Model=Gemma-3-27b-it2026.02 | 36 | — | — | — | — | — | — | — | — | — | — | — | — | — | 62.9 | — | |
| Optimized PromptBackbone Model=Gemma-3-27b-it2026.02 | 36 | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.1 | — | |
| AFBackbone Model=Mistral-Small-3.2-24B2026.02 | 35.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.6 | — | |
| Adv. Anon.Alias=A.A.2026.01 | 33.4 | 32.5 | 34.4 | 75.6 | 53.9 | 0 | 42.6 | 12.7 | 0 | 84.7 | 98.8 | 99.5 | 49 | 73 | 72.1 | 0.171 | |
| AFBackbone Model=Qwen3-30B-A3B2026.02 | 31.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | 56 | — | |
| Task-Specific PromptBackbone Model=Gemma-3-27b-it2026.02 | 23.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.4 | — | |
| Optimized PromptBackbone Model=Qwen3-30B-A3B2026.02 | 22.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | 94.4 | — | |
| Qwen3-30B-A3B (Optimized)Backbone=Qwen3-30B-A3B, Status=Optimized2026.02 | 22.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | 94.4 | — | |
| PromptBackbone=GPT-52026.02 | 18.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | 88.1 | — | |
| Seed PromptBackbone Model=Qwen3-30B-A3B2026.02 | 12.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | 92.4 | — | |
| OpenPII2026.02 | 9.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | 97.3 | — | |
| Task-Specific PromptBackbone Model=Qwen3-30B-A3B2026.02 | 7.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | 93.7 | — | |
| Seed PromptBackbone Model=Mistral-Small-3.2-24B2026.02 | 6.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.2 | — | |
| Task-Specific PromptBackbone Model=Mistral-Small-3.2-24B2026.02 | 5.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | 97.1 | — |