# ENACT: Entropy-based Clustering of Attention Input for Reducing the Computational Needs of Object Detection Transformers Source: [ENACT: Entropy-based Clustering of Attention Input for Reducing the Computational Needs of Object Detection Transformers]() Collection index: [llms.txt]() Data updated: 2025-10-26T04:50:02.046Z Authors: Giorgos Savathrakis, Antonis Argyros Published: 2024-09-11T18:03:59.000Z ## Abstract Transformers demonstrate competitive performance in terms of precision on the problem of vision-based object detection. However, they require considerable computational resources due to the quadratic size of the attention weights. In this work, we propose to cluster the transformer input on the basis of its entropy, due to its similarity between same object pixels. This is expected to reduce GPU usage during training, while maintaining reasonable accuracy. This idea is realized with an implemented module that is called ENtropy-based Attention Clustering for detection Transformers (ENACT), which serves as a plug-in to any multi-head self-attention based transformer network. Experiments on the COCO object detection dataset and three detection transformers demonstrate that the requirements on memory are reduced, while the detection accuracy is degraded only slightly. The code of the ENACT module is available at https://github.com/GSavathrakis/ENACT. ## Recorded benchmark results A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. ## Original sources and implementation [Original paper]() [PDF]()