arrow
Return

Graph-Enhanced Emotion Neural Decoding

delete2023-08-01
delete1
PRE
AI
Z
Zhongyu Huang
C
Changde Du
Y
Yingheng Wang
K
Kaicheng Fu
H
Huiguang He *
DOI:10.1109/TMI.2023.3246220delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Brain signal-based emotion recognition has recently attracted considerable attention since it has powerful potential to be applied in human-computer interaction. To realize the emotional interaction of intelligent systems with humans, researchers have made efforts to decode human emotions from brain imaging data. The majority of current efforts use emotion similarities (e.g., emotion graphs) or brain region similarities (e.g., brain networks) to learn emotion and brain representations. However, the relationships between emotions and brain regions are not explicitly incorporated into the representation learning process. As a result, the learned representations may not be informative enough to benefit specific tasks, e.g., emotion decoding. In this work, we propose a novel idea of graph-enhanced emotion neural decoding, which takes advantage of a bipartite graph structure to integrate the relationships between emotions and brain regions into the neural decoding process, thus helping learn better representations. Theoretical analyses conclude that the suggested emotion-brain bipartite graph inherits and generalizes the conventional emotion graphs and brain networks. Comprehensive experiments on visually evoked emotion datasets demonstrate the effectiveness and superiority of our approach.
Keywords:
Brain region
emotion
graph neural networks
neural decoding
representation

Journal

IEEE Transactions on Medical Imaging cover
IEEE Transactions on Medical Imaging
IF:
9.8
Papers:
6.3K
Citations:
3.7W

Organization

I
institute of automation, cas
Scholars:
2.2K
Papers: 2.1K
Citations: 2
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

The brain basis of emotion: A meta-analytic review
err2012-05-23
err1.6K
errOAAI
errLindquist, Kristen A.; Wager, Tor D.; Kober, Hedy; Bliss-Moreau, Eliza; Barrett, Lisa Feldman
errShare
errSave
The Cortical Network of Emotion Regulation: Insights From Advanced EEG-fMRI Integration Analysis
err2019-10-01
err46
PREAI
errThinh Nguyen; Zhou, Tiantong; Potter, Thomas; Zou, Ling; Zhang, Yinchun
errShare
errSave
The neuroscience of sadness: A multidisciplinary synthesis and collaborative review
err2020-04-01
err60
errOAAI
errArias, Juan A.; Williams, Claire; Raghvani, Rashmi; Aghajani, Moji; Baez, Sandra; Belzung, Catherine; Booij, Linda; Busatto, Geraldo; Chiarella, Julian; Fu, Cynthia H. Y.; Ibanez, Agustin; Liddell, Belinda J.; Lowe, Leroy; Penninx, Brenda W. J. H.; Rosa, Pedro; Kemp, Andrew H.
errShare
errSave
Xbox 360 Hoaxes, Social Engineering, and Gamertag Exploits
err2013-01-01
err0
PREAI
errAshley Podhradsky; Rob DOvidio; Pat Engebretson; Cindy Casey
errShare
errSave
Reliability of physical examination of the upper extremity among keyboard operators
err2000-04-01
err0
errOAAI
errDeborah F. Salerno; Alfred Franzblau; Robert A. Werner; Kevin C. Chung; J. Steven Schultz; Mark P. Becker; Thomas J. Armstrong
errShare
errSave
Fiabilidad y validez de las pruebas sit-and-reach: revisión sistemática
err2012-06-01
err0
errOAAI
errF. Ayala; P. Sainz de Baranda; M. de Ste Croix; F. Santonja
errShare
errSave
errShare
errSave
researcher View more