# FAQ: Feature Aggregated Queries for Transformer-based Video Object Detectors

Source: [FAQ: Feature Aggregated Queries for Transformer-based Video Object Detectors](<https://www.sota2.com/research/paper/68fa6ecf1e209131cea42552>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-04T04:28:28.708Z

Authors: Yiming Cui, Linjie Yang

Published: 2023-03-15T02:14:56.000Z

## Abstract

Video object detection needs to solve feature degradation situations that rarely happen in the image domain. One solution is to use the temporal information and fuse the features from the neighboring frames. With Transformerbased object detectors getting a better performance on the image domain tasks, recent works began to extend those methods to video object detection. However, those existing Transformer-based video object detectors still follow the same pipeline as those used for classical object detectors, like enhancing the object feature representations by aggregation. In this work, we take a different perspective on video object detection. In detail, we improve the qualities of queries for the Transformer-based models by aggregation. To achieve this goal, we first propose a vanilla query aggregation module that weighted averages the queries according to the features of the neighboring frames. Then, we extend the vanilla module to a more practical version, which generates and aggregates queries according to the features of the input frames. Extensive experimental results validate the effectiveness of our proposed methods: On the challenging ImageNet VID benchmark, when integrated with our proposed modules, the current state-of-the-art Transformer-based object detectors can be improved by more than 2.4% on mAP and 4.2% on AP50.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Video Object Detection on ImageNet VID (val)](<https://www.sota2.com/research/sota/video-object-detection-on-imagenet-vid-val.md>): Video Object Detection; ImageNet VID (val); mAP (%): 60.1.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2303.08319>)

[PDF](<https://arxiv.org/pdf/2303.08319.pdf>)
