arrow
返回

A deep interpretable representation learning method for speech emotion recognition

delete2023-11-01
delete9
PRE
AI
E
Erkang Jing
刘业政 (Yezheng Liu)
柴一栋 (Yidong Chai) *
孙见山 (Jianshan Sun)
S
Sagar Samtani
Y
Yuanchun Jiang
Y
Yang Qian
DOI:10.1016/j.ipm.2023.103501delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper focuses on the active interpretability for deep learning-based speech emotion recognition (SER). To achieve this, we propose an explicit feature constrained model, the interpretable group convolutional neural network (IG-CNN) model. In the proposed model, we first introduce the interpretability constraint to learn human-understandable interpretable representations. The emotion prediction decision can be active interpreted via the model coefficients. To acquire more representations beyond interpretable ones, and ensure they are useful for SER, we then design the uncorrelation constraint between interpretable and autonomous representations and introduce group CNN structure. We test the model on IEMOCAP, RAVDESS, eNTERFACE'05, and CREMA-D datasets. Experimental results show that our model outperforms all the baselines. In addition, the proposed model can also learn the patterns of human perception of speech emotion and provide explanation for the recognition results.
Keyword:
Speech signals
Emotion recognition
Affective computing
Interpretability
Representation learning
Deep learning

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
I
Indiana University Bloomington
学者数:
1.9W
论文数: 1.5W
被引数: 2.8W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
Deep learning for affective computing: Text-based emotion recognition in decision support
err2018-11-01
err181
errOAAI
errKratzwald, Bernhard; Ilic, Suzana; Kraus, Mathias; Feuerriegel, Stefan; Prendinger, Helmut
err分享
err收藏
Burned by a battery–coin short circuit: Old concept for a new burn
err2010-02-01
err0
PREAI
errRoba Khundkar; Claudia Malic; Catalina Estela
err分享
err收藏
err分享
err收藏
学者 查看更多内容