arrow
返回

Data-driven machine learning models for decoding speech categorization from evoked brain responses

delete2021-03-23
delete5
delete
OA
AI
M
Md Sultan Mahmud *
M
Mohammed Yeasin
G
Gavin M. Bidelman
DOI:10.1088/1741-2552/abecf0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Objective. Categorical perception (CP) of audio is critical to understand how the human brain perceives speech sounds despite widespread variability in acoustic properties. Here, we investigated the spatiotemporal characteristics of auditory neural activity that reflects CP for speech (i.e. differentiates phonetic prototypes from ambiguous speech sounds). Approach. We recorded 64-channel electroencephalograms as listeners rapidly classified vowel sounds along an acoustic-phonetic continuum. We used support vector machine classifiers and stability selection to determine when and where in the brain CP was best decoded across space and time via source-level analysis of the event-related potentials. Main results. We found that early (120 ms) whole-brain data decoded speech categories (i.e. prototypical vs. ambiguous tokens) with 95.16% accuracy (area under the curve 95.14%; F1-score 95.00%). Separate analyses on left hemisphere (LH) and right hemisphere (RH) responses showed that LH decoding was more accurate and earlier than RH (89.03% vs. 86.45% accuracy; 140 ms vs. 200 ms). Stability (feature) selection identified 13 regions of interest (ROIs) out of 68 brain regions [including auditory cortex, supramarginal gyrus, and inferior frontal gyrus (IFG)] that showed categorical representation during stimulus encoding (0-260 ms). In contrast, 15 ROIs (including fronto-parietal regions, IFG, motor cortex) were necessary to describe later decision stages (later 300-800 ms) of categorization but these areas were highly associated with the strength of listeners' categorical hearing (i.e. slope of behavioral identification functions). Significance. Our data-driven multivariate models demonstrate that abstract categories emerge surprisingly early (similar to 120 ms) in the time course of speech processing and are dominated by engagement of a relatively compact fronto-temporal-parietal brain network.
Keyword:
auditory event-related potentials (ERPs)
categorical perception
decision process
behavioral slope
machine learning
stability selection
support vector machine (SVM)

期刊

Journal of Neural Engineering 封面图
Journal of Neural Engineering
IF:
3.8
论文数:
4.0K
被引数:
1.4W

机构

U
University of Memphis
学者数:
3.4K
论文数: 3.2K
被引数: 3.8K
引用论文

引用论文

Efficacy of Oral Rehydration Solutions in a Rat Model of Secretory Diarrhea
err1987-07-01
err0
PREAI
errD. D. K. Rolston; M. M. Borodo; M. J. Kelly; A. M. Dawson; M. J. G. Farthing
err分享
err收藏
Manganese toxicity upon overexposure
err2004-12-23
err0
errOAAI
errJanelle Crossgrove; Wei Zheng
err分享
err收藏
err分享
err收藏
Distinct regional anatomic and functional correlates of neurodegenerative apraxia of speech and aphasia: An MRI and FDG-PET study语言和失语的神经退行性失用症的不同区域解剖和功能相关性: MRI和fdg-pet研究
err2013-06-01
err66
errOAAI
errWhitwell, Jennifer L.; Duffy, Joseph R.; Strand, Edythe A.; Xia, Rong; Mandrekar, Jay; Machulda, Mary M.; Senjem, Matthew L.; Lowe, Val J.; Jack, Clifford R., Jr.; Josephs, Keith A.
err分享
err收藏
Therapeutic efficacy of ipilimumab, an anti-CTLA-4 monoclonal antibody, in patients with metastatic melanoma unresponsive to prior systemic treatments: clinical and immunological evidence from three patient cases
err2009-01-13
err0
PREAI
errAnna Maria Di Giacomo; Riccardo Danielli; Massimo Guidoboni; Luana Calabrò; Dora Carlucci; Clelia Miracco; Luca Volterrani; Maria Antonietta Mazzei; Maurizio Biagioli; Maresa Altomonte; Michele Maio
err分享
err收藏
Perforations de la coiffe des rotateurs : intérêt de l’IRM 3,0T
err2009-05-01
err0
PREAI
errA Lambert; R Loffroy; B Guiu; N Mejean; JM Lerais; JP Cercueil; D Krausé
err分享
err收藏
学者 查看更多内容