Attribute Inference on Real-world Reddit-derived dataset 1.0 (test)
78.57Attribute Inference AccuracyNo Defense
Evaluation results
| Method | Links | |
|---|---|---|
| No DefenseTarget Model=GPT-4o, Target Model Accessibility=Closed-Source2026.02 | 78.57 | |
| D-DefenseTarget Model=GPT-4o, Target Model Accessibility=Closed-Source2026.02 | 77.14 | |
| No DefenseTarget Model=Gemini 2.5 Pro, Target Model Accessibility=Closed-Source2026.02 | 72.86 | |
| D-DefenseTarget Model=GPT-3.5, Target Model Accessibility=Closed-Source2026.02 | 72.86 | |
| D-DefenseTarget Model=Gemini 2.5 Pro, Target Model Accessibility=Closed-Source2026.02 | 72.86 | |
| No DefenseTarget Model=GPT-3.5, Target Model Accessibility=Closed-Source2026.02 | 65.71 | |
| No DefenseTarget Model=Llama2 13B-Chat, Target Model Accessibility=Open-Source2026.02 | 62.86 | |
| No DefenseTarget Model=Llama3.1 8B-Instruct, Target Model Accessibility=Open-Source2026.02 | 61.43 | |
| D-DefenseTarget Model=Llama2 13B-Chat, Target Model Accessibility=Open-Source2026.02 | 60 | |
| D-DefenseTarget Model=Llama2 7B-Chat, Target Model Accessibility=Open-Source2026.02 | 57.14 | |
| D-DefenseTarget Model=Llama3.1 8B-Instruct, Target Model Accessibility=Open-Source2026.02 | 54.29 | |
| No DefenseTarget Model=Llama2 7B-Chat, Target Model Accessibility=Open-Source2026.02 | 44.29 | |
| FgAAAnonymization Model=GPT-4o, Target Model=Gemini 2.5 Pro, Target Model Accessibility=Closed-Source2026.02 | 42.86 | |
| FgAAAnonymization Model=GPT-4o, Target Model=GPT-4o, Target Model Accessibility=Closed-Source2026.02 | 41.43 | |
| FgAAAnonymization Model=GPT-4o, Target Model=GPT-3.5, Target Model Accessibility=Closed-Source2026.02 | 37.14 | |
| TRACEAnonymization Model=GPT-4o, Target Model=Llama3.1 8B-Instruct, Target Model Accessibility=Open-Source2026.02 | 34.29 | |
| FgAAAnonymization Model=GPT-4o, Target Model=Llama3.1 8B-Instruct, Target Model Accessibility=Open-Source2026.02 | 32.86 | |
| TRACEAnonymization Model=GPT-4o, Target Model=Gemini 2.5 Pro, Target Model Accessibility=Closed-Source2026.02 | 32.86 | |
| TRACEAnonymization Model=GPT-4o, Target Model=GPT-4o, Target Model Accessibility=Closed-Source2026.02 | 30 | |
| TRACEAnonymization Model=GPT-4o, Target Model=GPT-3.5, Target Model Accessibility=Closed-Source2026.02 | 28.57 | |
| FgAAAnonymization Model=GPT-4o, Target Model=Llama2 13B-Chat, Target Model Accessibility=Open-Source2026.02 | 27.14 | |
| FgAAAnonymization Model=GPT-4o, Target Model=Llama2 7B-Chat, Target Model Accessibility=Open-Source2026.02 | 24.29 | |
| TRACEAnonymization Model=GPT-4o, Target Model=Llama2 13B-Chat, Target Model Accessibility=Open-Source2026.02 | 24.29 | |
| TRACEAnonymization Model=GPT-4o, Target Model=Llama2 7B-Chat, Target Model Accessibility=Open-Source2026.02 | 21.43 | |
| RPSTarget Model=Llama2 7B-Chat, Target Model Accessibility=Open-Source2026.02 | 7.14 | |
| TRACE-RPSAnonymization Model=GPT-4o, Target Model=Llama2 7B-Chat, Target Model Accessibility=Open-Source2026.02 | 4.29 | |
| RPSTarget Model=Llama2 13B-Chat, Target Model Accessibility=Open-Source2026.02 | 2.86 | |
| TRACE-RPSAnonymization Model=GPT-4o, Target Model=Llama2 13B-Chat, Target Model Accessibility=Open-Source2026.02 | 2.86 | |
| RPSTarget Model=Llama3.1 8B-Instruct, Target Model Accessibility=Open-Source2026.02 | 0 | |
| TRACE-RPSAnonymization Model=GPT-4o, Target Model=Llama3.1 8B-Instruct, Target Model Accessibility=Open-Source2026.02 | 0 |