arrow
Return

Multi-Classifier Interactive Learning for Ambiguous Speech Emotion Recognition

delete2022-01-01
delete31
delete
OA
AI
Y
Ying Zhou
X
Xuefeng Liang *
Y
Yu Gu
殷一飞 cover
殷一飞 (Yifei Yin)
L
Longshan Yao
DOI:10.1109/TASLP.2022.3145287delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In recent years, speech emotion recognition technology is of great significance in widespread applications such as call centers, social robots and health care. Thus, the speech emotion recognition has been attracted much attention in both industry and academic. Since emotions existing in an entire utterance may have varied probabilities, speech emotion is likely to be ambiguous, which poses great challenges to recognition tasks. However, previous studies commonly assigned a single-label or multi-label to each utterance in certain. Therefore, their algorithms result in low accuracies because of the inappropriate representation. Inspired by the optimally interacting theory, we address the ambiguous speech emotions by proposing a novel multi-classifier interactive learning (MCIL) method. In MCIL, multiple different classifiers first mimic several individuals, who have inconsistent cognitions of ambiguous emotions, and construct new ambiguous labels (the emotion probability distribution). Then, they are retrained with the new labels to interact with their cognitions. This procedure enables each classifier to learn better representations of ambiguous data from others, and further improves the recognition ability. The experiments on three benchmark corpora (MAS, IEMOCAP, and FAU-AIBO) demonstrate that MCIL does not only improve each classifier's performance, but also raises their recognition consistency from moderate to substantial.
Keywords:
Feature extraction
Speech recognition
Emotion recognition
Cognition
Training
Speech processing
Task analysis
Ambiguous data
optimal interactive learning
speech emotion recognition

Journal

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
Papers:
2.6K
Citations:
1.1W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K