# Isotropy Cliffs: The Geometric Signature of Decision-Making in Large Language Models

Source: [Isotropy Cliffs: The Geometric Signature of Decision-Making in Large Language Models](<https://www.sota2.com/research/paper/6a717258bc6f0f0705845de8>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-08-05T05:00:12.726Z

Authors: Okan S. Coskun, Florian Rottach, Carsten Eickhoff, William Rudman

Published: 2026-08-01T19:11:10.000Z

## Abstract

We investigate the geometry of decision-making in Multiple Choice Question Answering (MCQA) through the lens of isotropy. Analyzing five open-weight models across diverse datasets, we identify decision-critical transition layers characterized by a shift in isotropy, coinciding with a major representational change and the emergence of task-relevant clusters. We demonstrate that this synchronized geometric behavior is strongly correlated with downstream accuracy ($r\\approx0.84$), displaying its relevance for successful decision-making. Furthermore, we show that this transition is robust to prompt variations, suggesting that it reflects a general mechanism of model behavior.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2608.00828>)

[PDF](<https://arxiv.org/pdf/2608.00828.pdf>)
