# Bilinear Graph Networks for Visual Question Answering

Source: [Bilinear Graph Networks for Visual Question Answering](<https://www.sota2.com/research/paper/68fa66fb1e209131cea13680>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-25T07:44:12.810Z

Authors: Dalu Guo, Chang Xu, Dacheng Tao

Published: 2019-07-23T10:59:54.000Z

## Abstract

This paper revisits the bilinear attention networks in the visual question answering task from a graph perspective. The classical bilinear attention networks build a bilinear attention map to extract the joint representation of words in the question and objects in the image but lack fully exploring the relationship between words for complex reasoning. In contrast, we develop bilinear graph networks to model the context of the joint embeddings of words and objects. Two kinds of graphs are investigated, namely image-graph and question-graph. The image-graph transfers features of the detected objects to their related query words, enabling the output nodes to have both semantic and factual information. The question-graph exchanges information between these output nodes from image-graph to amplify the implicit yet important relationship between objects. These two kinds of graphs cooperate with each other, and thus our resulting model can model the relationship and dependency between objects, which leads to the realization of multi-step reasoning. Experimental results on the VQA v2.0 validation dataset demonstrate the ability of our method to handle the complex questions. On the test-std set, our best single model achieves state-of-the-art performance, boosting the overall accuracy to 72.41%.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Visual Question Answering on VQA v2 (test-dev)](<https://www.sota2.com/research/sota/visual-question-answering-on-vqa-v2-test-dev.md>): Visual Question Answering; VQA v2 (test-dev); Overall Accuracy: 72.28.

- [Visual Question Answering on VQA v2 (test-std)](<https://www.sota2.com/research/sota/visual-question-answering-on-vqa-v2-test-std.md>): Visual Question Answering; VQA v2 (test-std); Accuracy: not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1907.09815>)

[PDF](<https://arxiv.org/pdf/1907.09815.pdf>)