# Perception Test 2023: A Summary of the First Challenge And Outcome

Source: [Perception Test 2023: A Summary of the First Challenge And Outcome](<https://www.sota2.com/research/paper/68fa71851e209131cea51be1>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:57:03.221Z

Authors: Joseph Heyward, Jo\\~ao Carreira, Dima Damen, Andrew Zisserman, Viorica P\\u{a}tr\\u{a}ucean

Published: 2023-12-20T15:12:27.000Z

## Abstract

The First Perception Test challenge was held as a half-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2023, with the goal of benchmarking state-of-the-art video models on the recently proposed Perception Test benchmark. The challenge had six tracks covering low-level and high-level tasks, with both a language and non-language interface, across video, audio, and text modalities, and covering: object tracking, point tracking, temporal action localisation, temporal sound localisation, multiple-choice video question-answering, and grounded video question-answering. We summarise in this report the task descriptions, metrics, baselines, and results.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2312.13090>)

[PDF](<https://arxiv.org/pdf/2312.13090.pdf>)