# Is it all a cluster game? -- Exploring Out-of-Distribution Detection based on Clustering in the Embedding Space

Source: [Is it all a cluster game? -- Exploring Out-of-Distribution Detection based on Clustering in the Embedding Space](<https://www.sota2.com/research/paper/68fa6bfc1e209131cea316eb>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:01:55.246Z

Authors: Poulami Sinhamahapatra, Rajat Koner, Karsten Roscher, Stephan G\\"unnemann

Published: 2022-03-16T11:22:23.000Z

## Abstract

It is essential for safety-critical applications of deep neural networks to determine when new inputs are significantly different from the training distribution. In this paper, we explore this out-of-distribution (OOD) detection problem for image classification using clusters of semantically similar embeddings of the training data and exploit the differences in distance relationships to these clusters between in- and out-of-distribution data. We study the structure and separation of clusters in the embedding space and find that supervised contrastive learning leads to well-separated clusters while its self-supervised counterpart fails to do so. In our extensive analysis of different training methods, clustering strategies, distance metrics, and thresholding approaches, we observe that there is no clear winner. The optimal approach depends on the model architecture and selected datasets for in- and out-of-distribution. While we could reproduce the outstanding results for contrastive training on CIFAR-10 as in-distribution data, we find standard cross-entropy paired with cosine similarity outperforms all contrastive training methods when training on CIFAR-100 instead. Cross-entropy provides competitive results as compared to expensive contrastive training methods.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2203.08549>)

[PDF](<https://arxiv.org/pdf/2203.08549.pdf>)
