# Leveraged Mel spectrograms using Harmonic and Percussive Components in Speech Emotion Recognition

Source: [Leveraged Mel spectrograms using Harmonic and Percussive Components in Speech Emotion Recognition](<https://www.sota2.com/research/paper/68fa71891e209131cea51dc1>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:08:33.784Z

Authors: David Hason Rudd, Huan Huo, Guandong Xu

Published: 2023-12-18T05:55:46.000Z

## Abstract

Speech Emotion Recognition (SER) affective technology enables the intelligent embedded devices to interact with sensitivity. Similarly, call centre employees recognise customers' emotions from their pitch, energy, and tone of voice so as to modify their speech for a high-quality interaction with customers. This work explores, for the first time, the effects of the harmonic and percussive components of Mel spectrograms in SER. We attempt to leverage the Mel spectrogram by decomposing distinguishable acoustic features for exploitation in our proposed architecture, which includes a novel feature map generator algorithm, a CNN-based network feature extractor and a multi-layer perceptron (MLP) classifier. This study specifically focuses on effective data augmentation techniques for building an enriched hybrid-based feature map. This process results in a function that outputs a 2D image so that it can be used as input data for a pre-trained CNN-VGG16 feature extractor. Furthermore, we also investigate other acoustic features such as MFCCs, chromagram, spectral contrast, and the tonnetz to assess our proposed framework. A test accuracy of 92.79% on the Berlin EMO-DB database is achieved. Our result is higher than previous works using CNN-VGG16.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Speech Emotion Recognition on EMO-DB and RAVDESS](<https://www.sota2.com/research/sota/speech-emotion-recognition-on-emo-db-and-ravdess.md>): Speech Emotion Recognition; EMO-DB and RAVDESS; Accuracy: 92.79.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2312.10949>)

[PDF](<https://arxiv.org/pdf/2312.10949.pdf>)
