# TRI-DEP: A Trimodal Comparative Study for Depression Detection Using Speech, Text, and EEG

Source: [TRI-DEP: A Trimodal Comparative Study for Depression Detection Using Speech, Text, and EEG](<https://www.sota2.com/research/paper/68fa7c2a1e209131cea8ccb5>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-25T05:00:11.826Z

Authors: Annisaa Fitri Nurfidausi, Eleonora Mancini, Paolo Torroni

Published: 2025-10-16T17:39:59.000Z

## Abstract

Depression is a widespread mental health disorder, yet its automatic detection remains challenging. Prior work has explored unimodal and multimodal approaches, with multimodal systems showing promise by leveraging complementary signals. However, existing studies are limited in scope, lack systematic comparisons of features, and suffer from inconsistent evaluation protocols. We address these gaps by systematically exploring feature representations and modelling strategies across EEG, together with speech and text. We evaluate handcrafted features versus pre-trained embeddings, assess the effectiveness of different neural encoders, compare unimodal, bimodal, and trimodal configurations, and analyse fusion strategies with attention to the role of EEG. Consistent subject-independent splits are applied to ensure robust, reproducible benchmarking. Our results show that (i) the combination of EEG, speech and text modalities enhances multimodal detection, (ii) pretrained embeddings outperform handcrafted features, and (iii) carefully designed trimodal models achieve state-of-the-art performance. Our work lays the groundwork for future research in multimodal depression detection.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Depression Detection on MODMA (5-fold cross-val)](<https://www.sota2.com/research/sota/depression-detection-on-modma-5-fold-cross-val.md>): Depression Detection; MODMA (5-fold cross-val); Macro F1: 86.4.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2510.14922>)

[PDF](<https://arxiv.org/pdf/2510.14922.pdf>)
