arrow
Return

A multi-dilated convolution network for speech emotion recognition

delete2025-03-10
delete0
delete
OA
AI
S
Samaneh Madanian *
O
Olayinka Adeleye
J
John Michael Templeton
T
Talen Chen
C
Christian Poellabauer
E
Enshi Zhang
S
Sandra Schneider
DOI:10.1038/s41598-025-92640-2delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Speech emotion recognition (SER) is an important application in Affective Computing and Artificial Intelligence. Recently, there has been a significant interest in Deep Neural Networks using speech spectrograms. As the two-dimensional representation of the spectrogram includes more speech characteristics, research interest in convolution neural networks (CNNs) or advanced image recognition models is leveraged to learn deep patterns in a spectrogram to effectively perform SER. Accordingly, in this study, we propose a novel SER model based on the learning of the utterance-level spectrogram. First, we use the Spatial Pyramid Pooling (SPP) strategy to remove the size constraint associated with the CNN-based image recognition task. Then, the SPP layer is deployed to extract both the global-level prominent feature vector and multi-local-level feature vector, followed by an attention model to weigh the feature vectors. Finally, we apply the ArcFace layer, typically used for face recognition, to the SER task, thereby obtaining improved SER performance. Our model achieved an unweighted accuracy of 67.9% on IEMOCAP and 77.6% on EMODB datasets.
Keywords:
Speech emotion recognition
Deep learning
Convolution neural network
Loss layer
Spectrogram
Emotion recognition
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.1W
Citations:
83.5W

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
U
university of south florida
Scholars:
1.5W
Papers: 1.2W
Citations: 9
A
Auckland University of Technology
Scholars:
4.0K
Papers: 4.4K
Citations: 4.7K
researcher View more organizations