# Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention

Source: [Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention](<https://www.sota2.com/research/paper/68fa68c31e209131cea1e263>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:45:52.748Z

Authors: Varnith Chordia, Vijay Kumar BG

Published: 2020-11-23T21:22:54.000Z

## Abstract

Accurate and efficient product classification is significant for E-commerce applications, as it enables various downstream tasks such as recommendation, retrieval, and pricing. Items often contain textual and visual information, and utilizing both modalities usually outperforms classification utilizing either mode alone. In this paper we describe our methodology and results for the SIGIR eCom Rakuten Data Challenge. We employ a dual attention technique to model image-text relationships using pretrained language and image embeddings. While dual attention has been widely used for Visual Question Answering(VQA) tasks, ours is the first attempt to apply the concept for multimodal classification.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2011.11735>)

[PDF](<https://arxiv.org/pdf/2011.11735.pdf>)
