# Attribute Inference on Real-world Reddit-derived dataset 1.0 (test) Source: [Attribute Inference on Real-world Reddit-derived dataset 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:35:07.466Z Evaluation of Attribute Inference performance on the test split of the Real-world Reddit-derived dataset version 1.0, measured using Attribute inference accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Attribute Inference | | Dataset (including any stated split) | Real-world Reddit-derived dataset 1.0 (test) | | Metric | Attribute Inference Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Attribute Inference Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Attribute Inference Accuracy | Result date | Report paper | | --- | --- | --- | --- | | No Defense | 78.57 | Not recorded | 698eaff3c97a0b3e3b5e661c | | D-Defense | 77.14 | Not recorded | 698eaff3c97a0b3e3b5e661c | | No Defense | 72.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | D-Defense | 72.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | D-Defense | 72.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | No Defense | 65.71 | Not recorded | 698eaff3c97a0b3e3b5e661c | | No Defense | 62.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | No Defense | 61.43 | Not recorded | 698eaff3c97a0b3e3b5e661c | | D-Defense | 60 | Not recorded | 698eaff3c97a0b3e3b5e661c | | D-Defense | 57.14 | Not recorded | 698eaff3c97a0b3e3b5e661c | | D-Defense | 54.29 | Not recorded | 698eaff3c97a0b3e3b5e661c | | No Defense | 44.29 | Not recorded | 698eaff3c97a0b3e3b5e661c | | FgAA | 42.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | FgAA | 41.43 | Not recorded | 698eaff3c97a0b3e3b5e661c | | FgAA | 37.14 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE | 34.29 | Not recorded | 698eaff3c97a0b3e3b5e661c | | FgAA | 32.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE | 32.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE | 30 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE | 28.57 | Not recorded | 698eaff3c97a0b3e3b5e661c | | FgAA | 27.14 | Not recorded | 698eaff3c97a0b3e3b5e661c | | FgAA | 24.29 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE | 24.29 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE | 21.43 | Not recorded | 698eaff3c97a0b3e3b5e661c | | RPS | 7.14 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE-RPS | 4.29 | Not recorded | 698eaff3c97a0b3e3b5e661c | | RPS | 2.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE-RPS | 2.86 | Not recorded | 698eaff3c97a0b3e3b5e661c | | RPS | 0 | Not recorded | 698eaff3c97a0b3e3b5e661c | | TRACE-RPS | 0 | Not recorded | 698eaff3c97a0b3e3b5e661c | ### No Defense Attribute Inference Accuracy: 78.57. Result ID: 6996d7145698665ec4238413. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"GPT-4o","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### D-Defense Attribute Inference Accuracy: 77.14. Result ID: 6996d7145698665ec4238419. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"GPT-4o","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### No Defense Attribute Inference Accuracy: 72.86. Result ID: 6996d7145698665ec4238414. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### D-Defense Attribute Inference Accuracy: 72.86. Result ID: 6996d7145698665ec4238418. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"GPT-3.5","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### D-Defense Attribute Inference Accuracy: 72.86. Result ID: 6996d7145698665ec423841a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Gemini 2.5 Pro","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### No Defense Attribute Inference Accuracy: 65.71. Result ID: 6996d7145698665ec4238412. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"GPT-3.5","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### No Defense Attribute Inference Accuracy: 62.86. Result ID: 6996d7145698665ec4238410. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama2 13B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### No Defense Attribute Inference Accuracy: 61.43. Result ID: 6996d7145698665ec4238411. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama3.1 8B-Instruct","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### D-Defense Attribute Inference Accuracy: 60. Result ID: 6996d7145698665ec4238416. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama2 13B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### D-Defense Attribute Inference Accuracy: 57.14. Result ID: 6996d7145698665ec4238415. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama2 7B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### D-Defense Attribute Inference Accuracy: 54.29. Result ID: 6996d7145698665ec4238417. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama3.1 8B-Instruct","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### No Defense Attribute Inference Accuracy: 44.29. Result ID: 6996d7145698665ec423840f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama2 7B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### FgAA Attribute Inference Accuracy: 42.86. Result ID: 6996d7145698665ec4238423. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Gemini 2.5 Pro","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### FgAA Attribute Inference Accuracy: 41.43. Result ID: 6996d7145698665ec4238422. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"GPT-4o","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### FgAA Attribute Inference Accuracy: 37.14. Result ID: 6996d7145698665ec4238421. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"GPT-3.5","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### TRACE Attribute Inference Accuracy: 34.29. Result ID: 6996d7145698665ec4238426. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama3.1 8B-Instruct","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### FgAA Attribute Inference Accuracy: 32.86. Result ID: 6996d7145698665ec4238420. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama3.1 8B-Instruct","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### TRACE Attribute Inference Accuracy: 32.86. Result ID: 6996d7145698665ec4238429. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Gemini 2.5 Pro","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### TRACE Attribute Inference Accuracy: 30. Result ID: 6996d7145698665ec4238428. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"GPT-4o","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### TRACE Attribute Inference Accuracy: 28.57. Result ID: 6996d7145698665ec4238427. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"GPT-3.5","Target Model Accessibility":"Closed-Source"}. This record does not assert independent reproduction. ### FgAA Attribute Inference Accuracy: 27.14. Result ID: 6996d7145698665ec423841f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama2 13B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### FgAA Attribute Inference Accuracy: 24.29. Result ID: 6996d7145698665ec423841e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama2 7B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### TRACE Attribute Inference Accuracy: 24.29. Result ID: 6996d7145698665ec4238425. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama2 13B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### TRACE Attribute Inference Accuracy: 21.43. Result ID: 6996d7145698665ec4238424. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama2 7B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### RPS Attribute Inference Accuracy: 7.14. Result ID: 6996d7145698665ec423841b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama2 7B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### TRACE-RPS Attribute Inference Accuracy: 4.29. Result ID: 6996d7145698665ec423842a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama2 7B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### RPS Attribute Inference Accuracy: 2.86. Result ID: 6996d7145698665ec423841c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama2 13B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### TRACE-RPS Attribute Inference Accuracy: 2.86. Result ID: 6996d7145698665ec423842b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama2 13B-Chat","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### RPS Attribute Inference Accuracy: 0. Result ID: 6996d7145698665ec423841d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Model":"Llama3.1 8B-Instruct","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. ### TRACE-RPS Attribute Inference Accuracy: 0. Result ID: 6996d7145698665ec423842c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Anonymization Model":"GPT-4o","Target Model":"Llama3.1 8B-Instruct","Target Model Accessibility":"Open-Source"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.