arrow
返回

Graph-Enhanced Emotion Neural Decoding

delete2023-08-01
delete1
PRE
AI
Z
Zhongyu Huang
C
Changde Du
Y
Yingheng Wang
K
Kaicheng Fu
H
Huiguang He *
DOI:10.1109/TMI.2023.3246220delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Brain signal-based emotion recognition has recently attracted considerable attention since it has powerful potential to be applied in human-computer interaction. To realize the emotional interaction of intelligent systems with humans, researchers have made efforts to decode human emotions from brain imaging data. The majority of current efforts use emotion similarities (e.g., emotion graphs) or brain region similarities (e.g., brain networks) to learn emotion and brain representations. However, the relationships between emotions and brain regions are not explicitly incorporated into the representation learning process. As a result, the learned representations may not be informative enough to benefit specific tasks, e.g., emotion decoding. In this work, we propose a novel idea of graph-enhanced emotion neural decoding, which takes advantage of a bipartite graph structure to integrate the relationships between emotions and brain regions into the neural decoding process, thus helping learn better representations. Theoretical analyses conclude that the suggested emotion-brain bipartite graph inherits and generalizes the conventional emotion graphs and brain networks. Comprehensive experiments on visually evoked emotion datasets demonstrate the effectiveness and superiority of our approach.
Keyword:
Brain region
emotion
graph neural networks
neural decoding
representation

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

The brain basis of emotion: A meta-analytic review情绪的大脑基础: 元分析综述
err2012-05-23
err1.6K
errOAAI
errLindquist, Kristen A.; Wager, Tor D.; Kober, Hedy; Bliss-Moreau, Eliza; Barrett, Lisa Feldman
err分享
err收藏
The Cortical Network of Emotion Regulation: Insights From Advanced EEG-fMRI Integration Analysis
err2019-10-01
err46
PREAI
errThinh Nguyen; Zhou, Tiantong; Potter, Thomas; Zou, Ling; Zhang, Yinchun
err分享
err收藏
The neuroscience of sadness: A multidisciplinary synthesis and collaborative review悲伤的神经科学: 多学科综合与合作评论
err2020-04-01
err60
errOAAI
errArias, Juan A.; Williams, Claire; Raghvani, Rashmi; Aghajani, Moji; Baez, Sandra; Belzung, Catherine; Booij, Linda; Busatto, Geraldo; Chiarella, Julian; Fu, Cynthia H. Y.; Ibanez, Agustin; Liddell, Belinda J.; Lowe, Leroy; Penninx, Brenda W. J. H.; Rosa, Pedro; Kemp, Andrew H.
err分享
err收藏
Xbox 360 Hoaxes, Social Engineering, and Gamertag Exploits
err2013-01-01
err0
PREAI
errAshley Podhradsky; Rob DOvidio; Pat Engebretson; Cindy Casey
err分享
err收藏
Reliability of physical examination of the upper extremity among keyboard operators
err2000-04-01
err0
errOAAI
errDeborah F. Salerno; Alfred Franzblau; Robert A. Werner; Kevin C. Chung; J. Steven Schultz; Mark P. Becker; Thomas J. Armstrong
err分享
err收藏
Fiabilidad y validez de las pruebas sit-and-reach: revisión sistemática
err2012-06-01
err0
errOAAI
errF. Ayala; P. Sainz de Baranda; M. de Ste Croix; F. Santonja
err分享
err收藏
err分享
err收藏
学者 查看更多内容