# Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks

Source: [Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks](<https://www.sota2.com/research/paper/68fa63b61e209131cea003ca>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:56:34.448Z

Authors: Tanmay Gupta, Kevin Shih, Saurabh Singh, Derek Hoiem

Published: 2017-04-02T08:01:30.000Z

## Abstract

An important goal of computer vision is to build systems that learn visual representations over time that can be applied to many tasks. In this paper, we investigate a vision-language embedding as a core representation and show that it leads to better cross-task transfer than standard multi-task learning. In particular, the task of visual recognition is aligned to the task of visual question answering by forcing each to use the same word-region embeddings. We show this leads to greater inductive transfer from recognition to VQA than standard multitask learning. Visual recognition also improves, especially for categories that have relatively few recognition training labels but appear often in the VQA setting. Thus, our paper takes a small step towards creating more general vision systems by showing the benefit of interpretable, flexible, and trainable core representations.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1704.00260>)

[PDF](<https://arxiv.org/pdf/1704.00260.pdf>)
