.png){kind=icon}
返回
Decoding human brain activity with deep learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.bspc.2019.101730.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Building a brain-computer fusion system that would integrate biological intelligence and machine intelligence became a research topic of great concern. Recent research has proved that human brain activity can be decoded from neurological data. Meanwhile, deep learning has become an effective way to solve practical problems. Taking advantage of these trends, in this paper, we propose a novel method of decoding brain activity evoked by visual stimuli. To achieve this goal, we first introduce a combined long short-term memory-convolutional neural network (LSTM-CNN) architecture to extract the compact category-dependent representations of electroencephalograms (EEG). Our approach combines the ability of LSTM to extract sequential features and the capability of CNN to distil local features. Next, we employ an improved spectral normalization generative adversarial network (SNGAN) to conditionally generate images using the learned EEG features. We evaluate our approach in terms of the classification accuracy of EEG and the quality of the generated images. The results show that the proposed LSTM-CNN algorithm that discriminates the object classes by using EEG can be more accurate than the existing methods. In qualitative and quantitative tests, the improved SNGAN performs better in the task of generating conditional images from the learned EEG representations; the produced images are realistic and highly resemble the original images. Our method can reconstruct the content of visual stimuli according to the brain's response. Therefore, it helps to decode the human brain activity by using an image-EEG-image transformation. (C) 2019 Elsevier Ltd. All rights reserved.
Keyword:
Brain-computer fusion
Deep learning
EEG
Brain decoding
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.9
论文数:
1.0W
被引数:
2.4W
机构
引用论文
Oxidation Products of Biogenic Emissions Contribute to Nucleation of Atmospheric Particles.png)
Science
OAAI
ScienceIF0
OAAI分享收藏Generic decoding of seen and imagined objects using hierarchical visual featuresNATURE COMMUNICATIONS
OAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏Lead-carboxylate/polyiodide hybrids constructed from halogen bonding and asymmetric viologen: structures, visible-light-driven photocatalytic properties and enhanced photocurrent responsesCrystEngComm
CrystEngCommIF0
PREAI
分享收藏A broadband method of quantifying phase synchronization for discriminating seizure EEG signals一种用于鉴别癫痫发作EEG信号的量化相位同步的宽带方法OAAI
OAAI分享收藏
查看更多内容