# Mitigating Cross-Lingual Cultural Inconsistencies in LLMs via Consensus-Driven Preference Optimisation

Source: [Mitigating Cross-Lingual Cultural Inconsistencies in LLMs via Consensus-Driven Preference Optimisation](<https://www.sota2.com/research/paper/6a05570bdbc836b87d828c05>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-29T05:00:12.873Z

Authors: Lucas Resck, Isabelle Augenstein, Anna Korhonen

Published: 2026-04-02T14:04:06.000Z

## Abstract

Despite their impressive capabilities, multilingual large language models (MLLMs) frequently exhibit inconsistent behaviour when the prompt's language changes. While such adaptation is generally desirable, it becomes a critical failure when a user's identity is explicitly defined. For instance, given a fixed British persona and an ambiguous everyday knowledge query about literature, the prompt's language frequently overwrites the system persona -- yielding Shakespeare in English but Cervantes in Spanish. To robustly quantify this Cross-lingual Cultural Inconsistency, we introduce Singleton Fleiss's $\\kappa\_S$, a metric mathematically resilient to hallucinations. For mitigation, we propose Cross-lingual Cultural Consistent Preference Optimisation (C-3PO), a consensus-driven alignment framework. C-3PO achieves up to a 0.13-point absolute increase in $\\kappa\_S$ over unaligned models, consistently outperforming strong prompting and representation steering baselines whilst preserving explicit user identities, cultural neutrality and intrinsic cultural knowledge. Empirical evaluations demonstrate this inconsistency disproportionately affects lower-resource languages like Indonesian and Persian. Finally, early decoding of intermediate layers reveals that MLLMs implicitly personalise outputs towards the prompt language's stereotypical culture as forward-pass representations stabilise.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Cross-lingual Cultural Consistency on BLEnD All 8 Languages](<https://www.sota2.com/research/sota/cross-lingual-cultural-consistency-on-blend-all-8-languages.md>): Cross-lingual Cultural Consistency; BLEnD All 8 Languages; Max Sigma: 0.017.

- [Cross-lingual Cultural Consistency on BLEnD Higher-Resource](<https://www.sota2.com/research/sota/cross-lingual-cultural-consistency-on-blend-higher-resource.md>): Cross-lingual Cultural Consistency; BLEnD Higher-Resource; Max Sigma: 0.025.

- [Cross-lingual Cultural Consistency on BLEnD Lower-Resource](<https://www.sota2.com/research/sota/cross-lingual-cultural-consistency-on-blend-lower-resource.md>): Cross-lingual Cultural Consistency; BLEnD Lower-Resource; Max Sigma: 0.02.

- [Cross-lingual Cultural Consistency on BLEnD Indo-European](<https://www.sota2.com/research/sota/cross-lingual-cultural-consistency-on-blend-indo-european.md>): Cross-lingual Cultural Consistency; BLEnD Indo-European; Max Sigma: 0.021.

- [Cross-lingual Cultural Consistency on BLEnD Non-Indo-European](<https://www.sota2.com/research/sota/cross-lingual-cultural-consistency-on-blend-non-indo-european.md>): Cross-lingual Cultural Consistency; BLEnD Non-Indo-European; Max Sigma: 0.022.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2605.12515>)

[PDF](<https://arxiv.org/pdf/2605.12515.pdf>)
