# A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationships

Source: [A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationships](<https://www.sota2.com/research/paper/68fa74a71e209131cea62f7d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T03:14:35.342Z

Authors: Gracile Astlin Pereira, Muhammad Hussain

Published: 2024-08-27T16:22:18.000Z

## Abstract

Transformer-based models have transformed the landscape of natural language processing (NLP) and are increasingly applied to computer vision tasks with remarkable success. These models, renowned for their ability to capture long-range dependencies and contextual information, offer a promising alternative to traditional convolutional neural networks (CNNs) in computer vision. In this review paper, we provide an extensive overview of various transformer architectures adapted for computer vision tasks. We delve into how these models capture global context and spatial relationships in images, empowering them to excel in tasks such as image classification, object detection, and segmentation. Analyzing the key components, training methodologies, and performance metrics of transformer-based models, we highlight their strengths, limitations, and recent advancements. Additionally, we discuss potential research directions and applications of transformer-based models in computer vision, offering insights into their implications for future advancements in the field.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2408.15178>)

[PDF](<https://arxiv.org/pdf/2408.15178.pdf>)
