# V2S: A Tool for Translating Video Recordings of Mobile App Usages into Replayable Scenarios

Source: [V2S: A Tool for Translating Video Recordings of Mobile App Usages into Replayable Scenarios](<https://www.sota2.com/research/paper/68fa69701e209131cea22116>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:00:47.140Z

Authors: Madeleine Havranek, Carlos Bernal-C\\'ardenas, Nathan Cooper, Oscar Chaparro, Denys Poshyvnayk, Kevin Moran

Published: 2021-03-08T03:43:40.000Z

## Abstract

Screen recordings are becoming increasingly important as rich software artifacts that inform mobile application development processes. However, the amount of manual effort required to extract information from these graphical artifacts can hinder resource-constrained mobile developers. This paper presents Video2Scenario (V2S), an automated tool that processes video recordings of Android app usages, utilizes neural object detection and image classification techniques to classify the depicted user actions, and translates these actions into a replayable scenario. We conducted a comprehensive evaluation to demonstrate V2S's ability to reproduce recorded scenarios across a range of devices and a diverse set of usage cases and applications. The results indicate that, based on its performance with 175 videos depicting 3,534 GUI-based actions, V2S is accurate in reproducing $\\approx$89\\% of actions from collected videos.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2103.04531>)

[PDF](<https://arxiv.org/pdf/2103.04531.pdf>)