# Mutual information matrices are not always positive semi-definite

Source: [Mutual information matrices are not always positive semi-definite](<https://www.sota2.com/research/paper/68fa50611e209131ce96b027>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T10:49:33.456Z

Authors: Sune K. Jakobsen

Published: 2013-07-25T09:05:50.000Z

## Abstract

For discrete random variables X\_1,..., X\_n we construct an n by n matrix. In the (i,j) entry we put the mutual information I(X\_i;X\_j) between X\_i and X\_j. In particular, in the (i,i) entry we put the entropy H(X\_i)=I(X\_i;X\_i) of X\_i. This matrix, called the mutual information matrix of (X\_1,...,X\_n), has been conjectured to be positive semi-definite. In this note, we give counterexamples to the conjecture, and show that the conjecture holds for up to three random variables.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1307.6673>)

[PDF](<https://arxiv.org/pdf/1307.6673.pdf>)
