# Building and Evaluating a Realistic Virtual World for Large Scale Urban Exploration from 360{\\deg} Videos

Source: [Building and Evaluating a Realistic Virtual World for Large Scale Urban Exploration from 360{\\deg} Videos](<https://www.sota2.com/research/paper/68fa7c211e209131cea8c965>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T05:57:13.861Z

Authors: Mizuki Takenawa, Naoki Sugimoto, Leslie W\\"ohler, Satoshi Ikehata, Kiyoharu Aizawa

Published: 2025-10-13T14:17:06.000Z

## Abstract

We propose to build realistic virtual worlds, called 360RVW, for large urban environments directly from 360{\\deg} videos. We provide an interface for interactive exploration, where users can freely navigate via their own avatars. 360{\\deg} videos record the entire environment of the shooting location simultaneously leading to highly realistic and immersive representations. Our system uses 360{\\deg} videos recorded along streets and builds a 360RVW through four main operations: video segmentation by intersection detection, video completion to remove the videographer, semantic segmentation for virtual collision detection with the avatar, and projection onto a distorted sphere that moves along the camera trajectory following the avatar's movements. Our interface allows users to explore large urban environments by changing their walking direction at intersections or choosing a new location by clicking on a map. Even without a 3D model, the users can experience collision with buildings using metadata produced by semantic segmentation. Furthermore, we stream the 360{\\deg} videos so users can directly access 360RVW via their web browser. We fully evaluate our system, including a perceptual experiment comparing our approach to previous exploratory interfaces. The results confirm the quality of our system, especially regarding the presence of users and the interactive exploration, making it most suitable for a virtual tour of urban environments.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2510.11447>)

[PDF](<https://arxiv.org/pdf/2510.11447.pdf>)