# Exploiting Temporal Coherence for Multi-modal Video Categorization

Source: [Exploiting Temporal Coherence for Multi-modal Video Categorization](<https://www.sota2.com/research/paper/68fa67aa1e209131cea17982>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:19:06.029Z

Authors: Palash Goyal, Saurabh Sahu, Shalini Ghosh, Chul Lee

Published: 2020-02-07T06:42:12.000Z

## Abstract

Multimodal ML models can process data in multiple modalities (e.g., video, images, audio, text) and are useful for video content analysis in a variety of problems (e.g., object detection, scene understanding). In this paper, we focus on the problem of video categorization by using a multimodal approach. We have developed a novel temporal coherence-based regularization approach, which applies to different types of models (e.g., RNN, NetVLAD, Transformer). We demonstrate through experiments how our proposed multimodal video categorization models with temporal coherence out-perform strong state-of-the-art baseline models.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2002.03844>)

[PDF](<https://arxiv.org/pdf/2002.03844.pdf>)
