arrow
Return

Multi-Classifier Interactive Learning for Ambiguous Speech Emotion Recognition

delete2022-01-01
delete31
delete
OA
AI
Y
Ying Zhou
X
Xuefeng Liang *
Y
Yu Gu
殷一飞 cover
殷一飞 (Yifei Yin)
L
Longshan Yao
DOI:10.1109/TASLP.2022.3145287delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
In recent years, speech emotion recognition technology is of great significance in widespread applications such as call centers, social robots and health care. Thus, the speech emotion recognition has been attracted much attention in both industry and academic. Since emotions existing in an entire utterance may have varied probabilities, speech emotion is likely to be ambiguous, which poses great challenges to recognition tasks. However, previous studies commonly assigned a single-label or multi-label to each utterance in certain. Therefore, their algorithms result in low accuracies because of the inappropriate representation. Inspired by the optimally interacting theory, we address the ambiguous speech emotions by proposing a novel multi-classifier interactive learning (MCIL) method. In MCIL, multiple different classifiers first mimic several individuals, who have inconsistent cognitions of ambiguous emotions, and construct new ambiguous labels (the emotion probability distribution). Then, they are retrained with the new labels to interact with their cognitions. This procedure enables each classifier to learn better representations of ambiguous data from others, and further improves the recognition ability. The experiments on three benchmark corpora (MAS, IEMOCAP, and FAU-AIBO) demonstrate that MCIL does not only improve each classifier's performance, but also raises their recognition consistency from moderate to substantial.
Keywords:
Feature extraction
Speech recognition
Emotion recognition
Cognition
Training
Speech processing
Task analysis
Ambiguous data
optimal interactive learning
speech emotion recognition

Journal

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
Papers:
2.6K
Citations:
1.1W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

The IL-15 / sIL-15Rα complex modulates immunity without effect on asthma features in mouse
err2020-01-29
err0
errOAAI
errAntoine Moui; Martin Klein; Dorian Hassoun; Eléonore Dijoux; Marie-Aude Cheminant; Antoine Magnan; Grégory Bouchaud
errShare
errSave
errShare
errSave
Walk the Line—The Importance of Well-Informed Interpretation of QT Prolongation
err2020-06-13
err0
errOAAI
errZachary R. Noel; Vincent Y. See; Alexander H. Flannery
errShare
errSave
Controlled Anisotropic Growth of Co‐Fe‐P from Co‐Fe‐O Nanoparticles
err2015-06-26
err0
errOAAI
errAdriana Mendoza‐Garcia; Huiyuan Zhu; Yongsheng Yu; Qing Li; Lin Zhou; Dong Su; Matthew J. Kramer; Shouheng Sun
errShare
errSave
Substantial incorporation of isotopically heavy reduced U species into marine carbonate sediments
err2023-10-01
err0
PREAI
errYan Yuan; Tianyu Chen; Feifei Zhang; Yuanyuan Liu; Guolin Xiong; Guang-Yi Wei; Tais W. Dahl; Wen Yan; Hong-Fei Ling; Hai Cheng; Shu-Zhong Shen
errShare
errSave
Quantitative proteomic overview on the Corynebacterium glutamicum l-lysine producing strain DM1730
err2010-11-01
err0
PREAI
errBenjamin Fränzel; Ansgar Poetsch; Christian Trötschel; Marcus Persicke; Jörn Kalinowski; Dirk Andreas Wolters
errShare
errSave
researcher View more