# LLMs Silently Correct African American English: Auditing and Mitigating Dialect Bias via Activation Steering

Source: [LLMs Silently Correct African American English: Auditing and Mitigating Dialect Bias via Activation Steering](<https://www.sota2.com/research/paper/6a4f2b1a32fb937314875c0a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-10T05:00:01.278Z

Authors: Huan Wu, Ali Emami, Muhammad Furquan Hassan, Osaretin Igbinoba, Osakpolor Idusuyi, Osamede Igbinoba, Faiza Khan Khattak, Laleh Seyyed-Kalantari

Published: 2026-07-07T22:36:30.000Z

## Abstract

African American English (AAE), a rule-governed dialect spoken by over 30 million people, is routinely misinterpreted and "corrected" by large language models (LLMs). Across six instruction-tuned LLMs (14B to 70B), we show that state-of-the-art models systematically prefer Standard American English (SAE) continuations even when the preceding context is in AAE, effectively rewriting AAE into SAE. We present an end-to-end framework to audit and mitigate this bias. For auditing, we introduce conditional Dialect Group Invariance (cDGI), which isolates true model bias from translator-induced artifacts, and a feature-level localization analysis that identifies which AAE markers most strongly trigger bias; we find that syntactic constructions, especially negative concord (e.g., "ain't nobody"), are universal triggers across all models. For mitigation, we introduce, to our knowledge, the first application of activation steering to dialect bias: a training-free, test-time method that extracts dialect directions via causal tracing and injects them into bias-relevant layers. Activation steering reduces bias 5 to 20 times more than prompting while preserving SAE fluency. To enable this work, we release REAL-AAE , the largest real-AAE parallel corpus to date: 17,479 AAE/SAE/ AAE\_back triplets from natural tweets (2 to 6 times larger than prior real-AAE resources), validated automatically (BERTScore F1 = 0.95) and by three native AAE speakers (83.0% semantic agreement).

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Dialect Bias Evaluation on REAL-AAE](<https://www.sota2.com/research/sota/dialect-bias-evaluation-on-real-aae.md>): Dialect Bias Evaluation; REAL-AAE; DGI: 86.

- [Sentiment Classification on REAL-AAE (held-out evaluation set)](<https://www.sota2.com/research/sota/sentiment-classification-on-real-aae-held-out-evaluation-set.md>): Sentiment Classification; REAL-AAE (held-out evaluation set); DGI: not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2607.06845>)

[PDF](<https://arxiv.org/pdf/2607.06845.pdf>)
