# Can Large Language Models Grasp Event Signals? Exploring Pure Zero-Shot Event-based Recognition

Source: [Can Large Language Models Grasp Event Signals? Exploring Pure Zero-Shot Event-based Recognition](<https://www.sota2.com/research/paper/68fa762f1e209131cea6bb79>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:44:57.967Z

Authors: Zongyou Yu, Qiang Qu, Xiaoming Chen, Chen Wang

Published: 2024-09-15T06:43:03.000Z

## Abstract

Recent advancements in event-based zero-shot object recognition have demonstrated promising results. However, these methods heavily depend on extensive training and are inherently constrained by the characteristics of CLIP. To the best of our knowledge, this research is the first study to explore the understanding capabilities of large language models (LLMs) for event-based visual content. We demonstrate that LLMs can achieve event-based object recognition without additional training or fine-tuning in conjunction with CLIP, effectively enabling pure zero-shot event-based recognition. Particularly, we evaluate the ability of GPT-4o / 4turbo and two other open-source LLMs to directly recognize event-based visual content. Extensive experiments are conducted across three benchmark datasets, systematically assessing the recognition accuracy of these models. The results show that LLMs, especially when enhanced with well-designed prompts, significantly improve event-based zero-shot recognition performance. Notably, GPT-4o outperforms the compared models and exceeds the recognition accuracy of state-of-the-art event-based zero-shot methods on N-ImageNet by five orders of magnitude. The implementation of this paper is available at \\url{https://github.com/ChrisYu-Zz/Pure-event-based-recognition-based-LLM}.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2409.09628>)

[PDF](<https://arxiv.org/pdf/2409.09628.pdf>)
