arrow
返回

Deep learning for neural decoding in motor cortex

delete2022-09-23
delete9
PRE
AI
F
Fangyu Liu
S
Saber Meamardoost
R
Rudiyanto Gunawan
T
Takaki Komiyama
C
Claudia Mewes
张颖 (Ying Zhang)
E
Eun Jung Hwang *
L
Linbing Wang *
DOI:10.1088/1741-2552/ac8fb5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Objective. Neural decoding is an important tool in neural engineering and neural data analysis. Of various machine learning algorithms adopted for neural decoding, the recently introduced deep learning is promising to excel. Therefore, we sought to apply deep learning to decode movement trajectories from the activity of motor cortical neurons. Approach. In this paper, we assessed the performance of deep learning methods in three different decoding schemes, concurrent, time-delay, and spatiotemporal. In the concurrent decoding scheme where the input to the network is the neural activity coincidental to the movement, deep learning networks including artificial neural network (ANN) and long-short term memory (LSTM) were applied to decode movement and compared with traditional machine learning algorithms. Both ANN and LSTM were further evaluated in the time-delay decoding scheme in which temporal delays are allowed between neural signals and movements. Lastly, in the spatiotemporal decoding scheme, we trained convolutional neural network (CNN) to extract movement information from images representing the spatial arrangement of neurons, their activity, and connectomes (i.e. the relative strengths of connectivity between neurons) and combined CNN and ANN to develop a hybrid spatiotemporal network. To reveal the input features of the CNN in the hybrid network that deep learning discovered for movement decoding, we performed a sensitivity analysis and identified specific regions in the spatial domain. Main results. Deep learning networks (ANN and LSTM) outperformed traditional machine learning algorithms in the concurrent decoding scheme. The results of ANN and LSTM in the time-delay decoding scheme showed that including neural data from time points preceding movement enabled decoders to perform more robustly when the temporal relationship between the neural activity and movement dynamically changes over time. In the spatiotemporal decoding scheme, the hybrid spatiotemporal network containing the concurrent ANN decoder outperformed single-network concurrent decoders. Significance. Taken together, our study demonstrates that deep learning could become a robust and effective method for the neural decoding of behavior.
Keyword:
deep learning
neural decoding
neural signals
concurrent decoding
time-delay decoding
spatiotemporal decoding

期刊

Journal of Neural Engineering 封面图
Journal of Neural Engineering
IF:
3.8
论文数:
4.0K
被引数:
1.4W

机构

S
state university of new york (suny) system
学者数:
6.5W
论文数: 5.8W
被引数: 65
U
university at buffalo, suny
学者数:
1.2W
论文数: 9.5K
被引数: 9
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
U
University of California San Diego
学者数:
4.6W
论文数: 3.5W
被引数: 924
学者 查看更多机构
引用论文

引用论文

Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals
err2018-09-01
err1.1K
PREAI
errAcharya, U. Rajendra; Oh, Shu Lih; Hagiwara, Yuki; Tan, Jen Hong; Adeli, Hojjat
err分享
err收藏
Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities
err2017-07-11
err183
errOAAI
errGhafoorian, Mohsen; Karssemeijer, Nico; Heskes, Tom; van Uden, Inge W. M.; Sanchez, Clara I.; Litjens, Geert; de Leeuw, Frank-Erik; van Ginneken, Bram; Marchiori, Elena; Platel, Bram
err分享
err收藏
Meeting brain-computer interface user performance expectations using a deep neural network decoding framework使用深度神经网络解码框架满足脑机接口用户性能期望
err2018-09-24
err112
PREAI
errSchwemmer, Michael A.; Skomrock, Nicholas D.; Sederberg, Per B.; Ting, Jordyn E.; Sharma, Gaurav; Bockbrader, Marcia A.; Friedenberg, David A.
err分享
err收藏
Explainable machine-learning predictions for the prevention of hypoxaemia during surgery
err2018-10-10
err1.1K
errOAAI
errLundberg, Scott M.; Nair, Bala; Vavilala, Monica S.; Horibe, Mayumi; Eisses, Michael J.; Adams, Trevor; Liston, David E.; Low, Daniel King-Wai; Newman, Shu-Fang; Kim, Jerry; Lee, Su-In
err分享
err收藏
err分享
err收藏
学者 查看更多内容