# A real-time algorithm for human action recognition in RGB and thermal video

Source: [A real-time algorithm for human action recognition in RGB and thermal video](<https://www.sota2.com/research/paper/68fa6eed1e209131cea42edd>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:09:40.360Z

Authors: Hannes Fassold, Karlheinz Gutjahr, Anna Weber, Roland Perko

Published: 2023-04-04T06:44:13.000Z

## Abstract

Monitoring the movement and actions of humans in video in real-time is an important task. We present a deep learning based algorithm for human action recognition for both RGB and thermal cameras. It is able to detect and track humans and recognize four basic actions (standing, walking, running, lying) in real-time on a notebook with a NVIDIA GPU. For this, it combines state of the art components for object detection (Scaled YoloV4), optical flow (RAFT) and pose estimation (EvoSkeleton). Qualitative experiments on a set of tunnel videos show that the proposed algorithm works robustly for both RGB and thermal video.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2304.01567>)

[PDF](<https://arxiv.org/pdf/2304.01567.pdf>)
