# Alignment Defends LLMs from Property Inference Attacks

Source: [Alignment Defends LLMs from Property Inference Attacks](<https://www.sota2.com/research/paper/6a28f35290966ade919c184a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T05:00:05.512Z

Authors: Pengrun Huang, Chhavi Yadav, Ruihan Wu, Kamalika Chaudhuri

Published: 2026-06-08T22:15:20.000Z

## Abstract

Large language models (LLMs) are increasingly fine-tuned on domain-specific datasets that may contain sensitive, dataset-level properties. Recent work has shown that such dataset-level information can be effectively extracted through property inference attacks, posing a confidentiality risk. Existing defenses against these attacks primarily operate by modifying the training data distribution and hence require access to the original data and retraining the model, limiting their applicability to settings where data is unavailable or models are already deployed. In this work, we propose alignment-based defenses for mitigating property inference attacks in LLMs. Our approach reshapes the model's output distribution towards a target property ratio via post-training alignment, without modifying the training data. In particular, we adapt two widely used RLHF frameworks--Direct Preference Optimization (DPO) and Group Relative Policy Optimization (GRPO)--as our defenses by constructing preference pairs and defining a specific reward function respectively. Through comprehensive experiments, we show that our alignment based defenses effectively mitigate property inference attacks while maintaining a strong utility confidentiality tradeoff.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [CC on MedCalc](<https://www.sota2.com/research/sota/cc-on-medcalc.md>): CC; MedCalc; MAE: 0.0066.

- [QA on MedCalc](<https://www.sota2.com/research/sota/qa-on-medcalc.md>): QA; MedCalc; MAE: 0.0157.

- [Property Inference Defense on MedCalc CC](<https://www.sota2.com/research/sota/property-inference-defense-on-medcalc-cc.md>): Property Inference Defense; MedCalc CC; Generation Attack MAE: 0.0117.

- [Property Inference Defense on MedCalc QA](<https://www.sota2.com/research/sota/property-inference-defense-on-medcalc-qa.md>): Property Inference Defense; MedCalc QA; Generation Attack MAE: 0.0201.

- [CC on ChatDoctor](<https://www.sota2.com/research/sota/cc-on-chatdoctor.md>): CC; ChatDoctor; MAE: 0.0353.

- [QA (MAE) on ChatDoctor](<https://www.sota2.com/research/sota/qa-mae-on-chatdoctor.md>): QA; ChatDoctor; MAE: 0.0535.

- [Property Inference Defense on ChatDoctor QA](<https://www.sota2.com/research/sota/property-inference-defense-on-chatdoctor-qa.md>): Property Inference Defense; ChatDoctor QA; Generation Attack MAE: 0.1475.

- [Property Inference Defense on ChatDoctor CC](<https://www.sota2.com/research/sota/property-inference-defense-on-chatdoctor-cc.md>): Property Inference Defense; ChatDoctor CC; Generation Attack MAE: 0.1357.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2606.10217>)

[PDF](<https://arxiv.org/pdf/2606.10217.pdf>)
