.png){kind=icon}
返回
Multi-View Multi-Label Fine-Grained Emotion Decoding From Human Brain Activity
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2022.3217767.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Decoding emotional states from human brain activity play an important role in the brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain activity pattern and the decoded emotion categories are coarse-grained, which is inconsistent with the complex emotional expression of humans; the other is ignoring the discrepancy of emotion expression between the left and right hemispheres of the human brain. In this article, we propose a novel multi-view multi-label hybrid model for fine-grained emotion decoding (up to 80 emotion categories) which can learn the expressive neural representations and predict multiple emotional states simultaneously. Specifically, the generative component of our hybrid model is parameterized by a multi-view variational autoencoder, in which we regard the brain activity of left and right hemispheres and their difference as three distinct views and use the product of expert mechanism in its inference network. The discriminative component of our hybrid model is implemented by a multi-label classification network with an asymmetric focal loss. For more accurate emotion decoding, we first adopt a label-aware module for emotion-specific neural representation learning and then model the dependency of emotional states by a masked self-attention mechanism. Extensive experiments on two visually evoked emotional datasets show the superiority of our method.
Keyword:
Decoding
Brain modeling
Functional magnetic resonance imaging
Predictive models
Emotion recognition
Dimensionality reduction
Pattern recognition
Fine-grained emotion decoding
multi-label learning
multi-view learning
product of experts (PoEs)
variational autoencoder
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
.png){kind=icon}
Clinicopathologic profile of 470 giant cell tumors of bone from a cancer hospital in western India
PREAI
分享收藏
Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition面向跨主体情绪识别的主语不变脑电表征对比学习OAAI
OAAI分享收藏分享收藏
查看更多内容