# VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments

Source: [VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments](<https://www.sota2.com/research/paper/6a1d1206dbd7150506f83f1c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T05:00:05.014Z

Authors: Shivendra Agrawal, Bradley Hayes

Published: 2026-05-28T19:43:32.000Z

## Abstract

Global localization in geometrically aliased, quasi-static environments such as grocery stores, offices, schools, and hospitals poses a significant challenge for mobile robots. Grocery stores with parallel aisles and a long tailed distribution of products, as well as offices and labs with repetitive furniture such as chairs, desks, monitors, and doors, exemplify common indoor environments that present geometric and even semantic ambiguity. Traditional approaches rely either on distinct geometric features or on domain-specific vision pipelines that struggle with long-tail semantic distributions and transient visual clutter. We present VLM-GLoc, a method for hierarchical semantic Monte Carlo Localization (MCL) that leverages open-vocabulary Vision-Language Models (VLMs) as a unified semantic observation front-end. We hypothesize a three-fold benefit from VLMs: (1) extracting highly discriminative rich text features, (2) implicit quality filtering of blurry or dynamic objects, and (3) permanence reasoning for targeted data augmentation. We introduce an inverse semantic proposal mechanism that seeds particles via text-to-map retrieval. Evaluated across two real-world environments with different characteristics and two different platforms: a 3,500 sq. ft. grocery store with a cellphone and a 3,700 sq. ft. lab space with a quadruped, VLM-GLoc achieves 70% and 74% global localization success respectively, substantially outperforming traditional geometry-only and domain-specific baselines.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Global Localization on Grocery store 20 trajectories 3,500 sq. ft. space](<https://www.sota2.com/research/sota/global-localization-on-grocery-store-20-trajectories-3-500-sq-ft-space.md>): Global Localization; Grocery store 20 trajectories 3,500 sq. ft. space; Global Success Rate: 70.

- [Pose Tracking on Grocery store 20 trajectories 3,500 sq. ft. space](<https://www.sota2.com/research/sota/pose-tracking-on-grocery-store-20-trajectories-3-500-sq-ft-space.md>): Pose Tracking; Grocery store 20 trajectories 3,500 sq. ft. space; Track Percentage: 65.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2605.30506>)

[PDF](<https://arxiv.org/pdf/2605.30506.pdf>)