# Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions

Source: [Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions](<https://www.sota2.com/research/paper/68fa77eb1e209131cea75fbf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-11-26T05:01:54.158Z

Authors: Angela Lopez-Cardona, Sebastian Idesis, Ioannis Arapakis

Published: 2025-04-09T13:01:48.000Z

## Abstract

Recently, the integration of cognitive neuroscience in Natural Language Processing (NLP) has gained significant attention. This article provides a critical and timely overview of recent advancements in leveraging cognitive signals, particularly Eye-tracking (ET) signals, to enhance Language Models (LMs) and Multimodal Large Language Models (MLLMs). By incorporating user-centric cognitive signals, these approaches address key challenges, including data scarcity and the environmental costs of training large-scale models. Cognitive signals enable efficient data augmentation, faster convergence, and improved human alignment. The review emphasises the potential of ET data in tasks like Visual Question Answering (VQA) and mitigating hallucinations in MLLMs, and concludes by discussing emerging challenges and research trends.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2504.06843>)

[PDF](<https://arxiv.org/pdf/2504.06843.pdf>)
