Attribute Inference on Synthetic Dataset
71.24Attribute Inference AccuracyNo Defense
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No DefenseInference Model=GPT-4o2026.02 | 71.24 | — | |
| No DefenseInference Model=Gemini 2.5 Pro2026.02 | 68.38 | — | |
| No DefenseInference Model=GPT-3.52026.02 | 67.62 | — | |
| D-DefenseInference Model=GPT-4o2026.02 | 64.95 | — | |
| D-DefenseInference Model=Gemini 2.5 Pro2026.02 | 63.24 | — | |
| D-DefenseInference Model=GPT-3.52026.02 | 62.29 | — | |
| No DefenseTarget Model=Qwen2.5-7B-Instruct2026.02 | 57.52 | — | |
| No DefenseInference Model=Llama3.1-8B-Instruct2026.02 | 57.14 | — | |
| No DefenseInference Model=Llama2-13B-Chat2026.02 | 56.19 | — | |
| AzureInference Model=GPT-4o2026.02 | 56 | — | |
| No DefenseInference Model=Llama2-7B-Chat2026.02 | 53.71 | — | |
| D-DefenseInference Model=Llama2-13B-Chat2026.02 | 52.76 | — | |
| No DefenseInference Model=DeepSeek-R1 Distill2026.02 | 49.71 | — | |
| D-DefenseInference Model=Llama3.1-8B-Instruct2026.02 | 49.71 | — | |
| D-DefenseInference Model=Llama2-7B-Chat2026.02 | 48 | — | |
| D-DefenseTarget Model=Qwen2.5-7B-Instruct2026.02 | 48 | — | |
| D-DefenseInference Model=DeepSeek-R1 Distill2026.02 | 47.05 | — | |
| Dou-SDInference Model=GPT-4o2026.02 | 47 | — | |
| FgAATarget Model=Qwen2.5-7B-Instruct, Anonymization Model=GPT-3.5-Turbo2026.02 | 28.76 | — | |
| FgAAAnonymization Model=GPT-3.5-Turbo, Inference Model=DeepSeek-R1 Distill2026.02 | 23.24 | — | |
| TRACETarget Model=Qwen2.5-7B-Instruct, Anonymization Model=GPT-3.5-Turbo2026.02 | 22.67 | — | |
| TRACEAnonymization Model=GPT-3.5-Turbo, Inference Model=Llama2-7B-Chat2026.02 | 22.48 | — | |
| FgAATarget Model=Qwen2.5-7B-Instruct, Anonymization Model=GPT-4o2026.02 | 22.1 | — | |
| TRACETarget Model=Qwen2.5-7B-Instruct, Anonymization Model=GPT-4o2026.02 | 18.86 | — | |
| MPSTarget Model=Qwen2.5-7B-Instruct2026.02 | 10.29 | — | |
| RPSInference Model=DeepSeek-R1 Distill2026.02 | 6.48 | 17.59 | |
| TRACE-MPSTarget Model=Qwen2.5-7B-Instruct, Anonymization Model=GPT-3.5-Turbo2026.02 | 5.14 | — | |
| RPSInference Model=Llama2-13B-Chat2026.02 | 4.38 | 16.09 | |
| TRACE-MPSTarget Model=Qwen2.5-7B-Instruct, Anonymization Model=GPT-4o2026.02 | 4.38 | — | |
| TRACE-RPSAnonymization Model=GPT-4o, Inference Model=DeepSeek-R1 Distill2026.02 | 2.86 | 14.07 | |
| RPSInference Model=Llama2-7B-Chat2026.02 | 1.71 | 14.1 | |
| TRACE-RPSAnonymization Model=GPT-3.5-Turbo, Inference Model=Llama2-7B-Chat2026.02 | 0.19 | 12.82 | |
| RPSInference Model=Llama3.1-8B-Instruct2026.02 | 0 | 13.48 |