arrow
返回

Emotion detection from multilingual audio using deep analysis

delete2022-05-20
delete11
PRE
AI
S
Sudipta Bhattacharya
S
Samarjeet Borah *
B
Brojo Kishore Mishra
A
Atreyee Mondal
DOI:10.1007/s11042-022-12411-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human emotion detection from multiple languages is a very challenging job. In this work, we have used language emotional databases of various languages such as - Ryerson-Audio-Visual database (RAVDESS), Berlin Database (EmoDb) and Italian Database (Emo-Vo) which are in English, German and Italian languages respectively. The proposed model extract MFCC, chroma, Tonnetz, Contrast from the raw audio file, which is further taken as input in the CNN model to identify emotions correctly. We are not using any visual representation of sound only direct from natural sound data. An extensive comparison is made with some of the previous approaches on emotion detection from speech. The experimental result shows that; the proposed model has successfully worked with all the selected databases with higher accuracy. The same also has been tested with the augmented database. We secure 70.46% for RAVDESS, 70.37% Emo-Db and 73.47% for Emo-Vo in the initial database and best model work in the augmented database. However, test with Original test dataset, secured 96.53% in RAVDESS 96.22% in Emo-Db and Emo-Vo 96.11% respectively. Multilingual Emotion detection, a state of art model, has been discussed with an accuracy of 97.89%. The proposed model is a speaker-independent as well as language-independent emotion detection system.
Keyword:
Deep learning
Convolution neural network
Speech
Emotion detection
RAVDESS
EmoDb
Emo-vo
MFCC

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

Sikkim Manipal University 封面图
Sikkim Manipal University
学者数:
422
论文数: 319
被引数: 311
G
GIET University
学者数:
254
论文数: 203
被引数: 158
引用论文

引用论文

A Pilot Study on Delirium in the Intensive Care Unit
err2013-01-01
err0
PREAI
errJohn J. Whitcomb; Michelle Morgan; Tameka Irvin; Kathleen Spencer; Lauren Boynton; Sarah Turman; Christopher Rhodes
err分享
err收藏
err分享
err收藏
The modulation of thermal properties of vinblastine by cholesterol in membrane bilayers
err2004-02-01
err0
errOAAI
errIoanna Kyrikou; Ioanna Daliani; Thomas Mavromoustakos; Hamzah Maswadeh; Costas Demetzos; Sophia Hatziantoniou; Sarantis Giatrellis; George Nounesis
err分享
err收藏
Developments in modern panoramic lenses: lens design, controlled distortion, and characterization
err2011-11-23
err0
PREAI
errSimon Thibault; Jocelyn Parent; Hu Zhang; Martin Larivière-Bastien; Anne-Sophie Poulin-Girard; Aymen Arfaoui; Pierre Désaulniers
err分享
err收藏
学者 查看更多内容