# Translation from the Information Bottleneck Perspective: an Efficiency Analysis of Spatial Prepositions in Bitexts

Source: [Translation from the Information Bottleneck Perspective: an Efficiency Analysis of Spatial Prepositions in Bitexts](<https://www.sota2.com/research/paper/69c0c8ea0636e5bf4afc3a6b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T05:00:12.103Z

Authors: Antoine Taroni, Ludovic Moncla, Frederique Laforest

Published: 2026-03-20T13:09:33.000Z

## Abstract

Efficient communication requires balancing informativity and simplicity when encoding meanings. The Information Bottleneck (IB) framework captures this trade-off formally, predicting that natural language systems cluster near an optimal accuracy-complexity frontier. While supported in visual domains such as colour and motion, linguistic stimuli such as words in sentential context remain unexplored. We address this gap by framing translation as an IB optimisation problem, treating source sentences as stimuli and target sentences as compressed meanings. This allows IB analyses to be performed directly on bitexts rather than controlled naming experiments. We applied this to spatial prepositions across English, German and Serbian translations of a French novel. To estimate informativity, we conducted a pile-sorting pilot-study (N=35) and obtained similarity judgements of pairs of prepositions. We trained a low-rank projection model (D=5) that predicts these judgements (Spearman correlation: 0.78). Attested translations of prepositions lie closer to the IB optimal frontier than counterfactual alternatives, offering preliminary evidence that human translators exhibit communicative efficiency pressure in the spatial domain. More broadly, this work suggests that translation can serve as a window into the cognitive efficiency pressures shaping cross-linguistic semantic systems.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Semantic Similarity Prediction on Human pile-sorting judgements (6-fold nested cross val)](<https://www.sota2.com/research/sota/semantic-similarity-prediction-on-human-pile-sorting-judgements-6-fold-nested-cross-val.md>): Semantic Similarity Prediction; Human pile-sorting judgements (6-fold nested cross val); Spearman ρ: 0.78.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.19924>)

[PDF](<https://arxiv.org/pdf/2603.19924.pdf>)
