arrow
返回

Machine learning algorithm for decoding multiple subthalamic spike trains for speech brain-machine interfaces

delete2021-11-25
delete9
PRE
AI
A
Ariel Tankus *
L
Lior Solomon
Y
Yotam Aharony
A
Achinoam Faust‐Socher
I
Ido Strauss
DOI:10.1088/1741-2552/ac3315delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Objective. The goal of this study is to decode the electrical activity of single neurons in the human subthalamic nucleus (STN) to infer the speech features that a person articulated, heard or imagined. We also aim to evaluate the amount of subthalamic neurons required for high accuracy decoding suitable for real-life speech brain-machine interfaces (BMI). Approach. We intraoperatively recorded single-neuron activity in the STN of 21 neurosurgical patients with Parkinson's disease undergoing implantation of deep brain stimulator while patients produced, perceived or imagined the five monophthongal vowel sounds. Our decoder is based on machine learning algorithms that dynamically learn specific features of the speech-related firing patterns. Main results. In an extensive comparison of algorithms, our sparse decoder ('SpaDe'), based on sparse decomposition of the high dimensional neuronal feature space, outperformed the other algorithms in all three conditions: production, perception and imagery. For speech production, our algorithm, Spade, predicted all vowels correctly (accuracy: 100%; chance level: 20%). For perception accuracy was 96%, and for imagery: 88%. The accuracy of Spade showed a linear behavior in the amount of neurons for the perception data, and even faster for production or imagery. Significance. Our study demonstrates that the information encoded by single neurons in the STN about the production, perception and imagery of speech is suitable for high-accuracy decoding. It is therefore an important step towards BMIs for restoration of speech faculties that bears an enormous potential to alleviate the suffering of completely paralyzed ('locked-in') patients and allow them to communicate again with their environment. Moreover, our research indicates how many subthalamic neurons may be necessary to achieve each level of decoding accuracy, which is of supreme importance for a neurosurgeon planning the implantation of a speech BMI.
Keyword:
brain-machine interface
decoding
speech
single unit recordings
human neurophysiology
subthalamic nucleus
vowels

期刊

Journal of Neural Engineering 封面图
Journal of Neural Engineering
IF:
3.8
论文数:
4.0K
被引数:
1.5W

机构

S
Sackler Faculty of Medicine
学者数:
53
论文数: 51
被引数: 10
T
Tel Aviv University
学者数:
1.1K
论文数: 463
被引数: 176
引用论文

引用论文

Decoding gripping force based on local field potentials recorded from subthalamic nucleus in humans
err2016-11-18
err41
errOAAI
errTan, Huiling; Pogosyan, Alek; Ashkan, Keyoumars; Green, Alexander L.; Aziz, Tipu; Foltynie, Thomas; Limousin, Patricia; Zrinzo, Ludvic; Hariz, Marwan; Brown, Peter
err分享
err收藏
Direct classification of all American English phonemes using signals from functional speech motor cortex
err2014-05-19
err164
errOAAI
errMugler, Emily M.; Patton, James L.; Flint, Robert D.; Wright, Zachary A.; Schuele, Stephan U.; Rosenow, Joshua; Shih, Jerry J.; Krusienski, Dean J.; Slutzky, Marc W.
err分享
err收藏
Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration通过大脑控制的肌肉刺激恢复四肢瘫痪患者的伸手和抓握运动: 概念验证演示
errLANCET
IF88.5
err2017-05-01
err584
errOAAI
errAjiboye, A. Bolu; Willett, Francis R.; Young, Daniel R.; Memberg, William D.; Murphy, Brian A.; Miller, Jonathan P.; Walter, Benjamin L.; Sweet, Jennifer A.; Hoyen, Harry A.; Keith, Michael W.; Peckham, P. Hunter; Simeral, John D.; Donoghue, John P.; Hochberg, Leigh R.; Kirsch, Robert F.
err分享
err收藏
err分享
err收藏
Real-time decoding of question-and-answer speech dialogue using human cortical activity
err2019-07-30
err144
errOAAI
errMoses, David A.; Leonard, Matthew K.; Makin, Joseph G.; Chang, Edward F.
err分享
err收藏
学者 查看更多内容