# Discriminatory Compliance: How LLMs Answer Queries from Protected Groups

Source: [Discriminatory Compliance: How LLMs Answer Queries from Protected Groups](<https://www.sota2.com/research/paper/6a3a12eb206542251d7c6e54>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-24T05:00:04.551Z

Authors: Dinesh Ayyappan, Carlos Castillo

Published: 2026-06-19T10:19:54.000Z

## Abstract

Chatbots developed using Large Language Models (LLMs) implement various safeguards for sensitive questions and/or scenarios. These safeguards require making certain assumptions about the person asking the question. We define discriminatory compliance as patterns in question answering that disproportionately disadvantage users from minority or protected backgrounds, for instance by omitting information that would be valuable for them. In this paper, we show that state-of-the-art LLMs respond inconsistently to questions from personas from protected identity groups, and that some of these inconsistencies mean that key information that should be provided to minority or protected background personas is missing. We show that this behavior is, additionally, inconsistent across and within model providers as well as across background conditions and ways of phrasing those conditions.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2606.21296>)

[PDF](<https://arxiv.org/pdf/2606.21296.pdf>)
