arrow
Return

Deep learning based affective computing

delete2021-10-18
delete14
PRE
AI
S
Saurabh Kumar *
DOI:10.1108/JEIM-12-2020-0536delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Purpose Decision-making in human beings is affected by emotions and sentiments. The affective computing takes this into account, intending to tailor decision support to the emotional states of people. However, the representation and classification of emotions is a very challenging task. The study used customized methods of deep learning models to aid in the accurate classification of emotions and sentiments. Design/methodology/approach The present study presents affective computing model using both text and image data. The text-based affective computing was conducted on four standard datasets using three deep learning customized models, namely LSTM, GRU and CNN. The study used four variants of deep learning including the LSTM model, LSTM model with GloVe embeddings, Bi-directional LSTM model and LSTM model with attention layer. Findings The result suggests that the proposed method outperforms the earlier methods. For image-based affective computing, the data was extracted from Instagram, and Facial emotion recognition was carried out using three deep learning models, namely CNN, transfer learning with VGG-19 model and transfer learning with ResNet-18 model. The results suggest that the proposed methods for both text and image can be used for affective computing and aid in decision-making. Originality/value The study used deep learning for affective computing. Earlier studies have used machine learning algorithms for affective computing. However, the present study uses deep learning for affective computing.
Keywords:
Affective computing
Deep learning
Visualization
LSTM
CNN
GRU

Journal

Journal of Enterprise Information Management cover
Journal of Enterprise Information Management
IF:
6.4
Papers:
692
Citations:
4.4K

Organization

I
indian institute of management (iim system)
Scholars:
3.4K
Papers: 4.4K
Citations: 7
Cited Papers

Cited Papers

Designing for deep learning in the context of digital and social media
err2019-01-01
err38
errOAAI
errGee, James-Paul; Esteban-Guitart, Moises
errShare
errSave
Inhibitors of protein kinase C. 1. 2,3-bisarylmaleimides
err2002-05-01
err0
PREAI
errPeter D. Davis; Christopher H. Hill; Geoffrey Lawton; John S. Nixon; Sandra E. Wilkinson; Steven A. Hurst; Elizabeth Keech; Susan E. Turner
errShare
errSave
Causal effects of physical activity and sedentary behaviour on health deficits accumulation in older adults
err2020-05-11
err0
errOAAI
errEsther García-Esquinas; Rosario Ortolá; David Martínez-Gómez; Javier Damián; Matthew Prina; Fernando Rodríguez-Artalejo; Roberto Pastor-Barriuso
errShare
errSave
Deep learning for affective computing: Text-based emotion recognition in decision support
err2018-11-01
err181
errOAAI
errKratzwald, Bernhard; Ilic, Suzana; Kraus, Mathias; Feuerriegel, Stefan; Prendinger, Helmut
errShare
errSave
Comparing ensemble strategies for deep learning: An application to facial expression recognition
err2019-12-01
err38
errOAAI
errRenda, Alessandro; Barsacchi, Marco; Bechini, Alessio; Marcelloni, Francesco
errShare
errSave
Seroepidemiological correlations of antibodies to human herpesviruses and human immunodeficiency virus type 1 in African patients
err1991-11-01
err0
PREAI
errS. Essers; A. Schwinn; J. ter Meulen; H. von Lips; K. Dietz; F. S. Mhalu; J. Shao; V. ter Meulen
errShare
errSave
LSTM-Modeling of continuous emotions in an audiovisual affect recognition framework
err2013-02-01
err205
errOAAI
errWoellmer, Martin; Kaiser, Moritz; Eyben, Florian; Schuller, Bjoern; Rigoll, Gerhard
errShare
errSave
researcher View more