# Compositional Mixture Representations for Vision and Text

Source: [Compositional Mixture Representations for Vision and Text](<https://www.sota2.com/research/paper/68fa6cc71e209131cea35ef1>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:15:31.627Z

Authors: Stephan Alaniz, Marco Federici, Zeynep Akata

Published: 2022-06-13T18:16:40.000Z

## Abstract

Learning a common representation space between vision and language allows deep networks to relate objects in the image to the corresponding semantic meaning. We present a model that learns a shared Gaussian mixture representation imposing the compositionality of the text onto the visual domain without having explicit location supervision. By combining the spatial transformer with a representation learning approach we learn to split images into separately encoded patches to associate visual and textual representations in an interpretable manner. On variations of MNIST and CIFAR10, our model is able to perform weakly supervised object detection and demonstrates its ability to extrapolate to unseen combination of objects.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2206.06404>)

[PDF](<https://arxiv.org/pdf/2206.06404.pdf>)
