# ROSA: Addressing text understanding challenges in photographs via ROtated SAmpling

Source: [ROSA: Addressing text understanding challenges in photographs via ROtated SAmpling](<https://www.sota2.com/research/paper/68fa79131e209131cea7bfe8>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:53:53.053Z

Authors: Hern\\'an Maina, Guido Ivetta, Mateo Lione Stuto, Julian Martin Eisenschlos, Jorge S\\'anchez, Luciana Benotti

Published: 2025-06-04T07:56:13.000Z

## Abstract

Visually impaired people could benefit from Visual Question Answering (VQA) systems to interpret text in their surroundings. However, current models often struggle with recognizing text in the photos taken by this population. Through in-depth interviews with visually impaired individuals, we identified common framing conventions that frequently result in misaligned text. Existing VQA benchmarks primarily feature well-oriented text captured by sighted users, under-representing these challenges. To address this gap, we introduce ROtated SAmpling (ROSA), a decoding strategy that enhances VQA performance in text-rich images with incorrectly oriented text. ROSA outperforms Greedy decoding by 11.7 absolute points in the best-performing model.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2506.03665>)

[PDF](<https://arxiv.org/pdf/2506.03665.pdf>)
