.png){kind=icon}
返回
Finding structure during incremental speech comprehension
.png){kind=icon}
OA
AI
DOI：10.7554/eLife.89311.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker's intended meaning. This rapid process is subject to multidimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints. Using representational similarity analysis, we tested BERT parse depths and relevant corpus-based measures against the spatiotemporally resolved brain activity recorded by electro-/magnetoencephalography when participants were listening to the same sentences. Our results provide a detailed picture of the neurobiological processes involved in the incremental construction of structured interpretations. These findings show when and where coherent interpretations emerge through the evaluation and integration of multifaceted constraints in the brain, which engages bilateral brain regions extending beyond the classical fronto-temporal language system. Furthermore, this study provides empirical evidence supporting the use of artificial neural networks as computational models for revealing the neural dynamics underpinning complex cognitive processes in the brain.
Keyword:
incremental speech comprehension
deep language models
sentence structure
parsing
electroencephalography
magnetoencephalography
EEG
MEG
Human
期刊
IF:
0
论文数:
1.8W
被引数:
16
机构
引用论文
Sodium channel kinetic changes that produce Brugada syndrome or progressive cardiac conduction system disease产生Brugada综合征或进行性心脏传导系统疾病的钠通道动力学变化
PREAI
分享收藏分享收藏Determinants of institutional childbirth service utilisation among women of childbearing age in urban and rural areas of Tsegedie district, Ethiopia.png)
Midwifery
MidwiferyIF0
PREAI
分享收藏分享收藏Trends in mortality from 1965 to 2008 across the English north-south divide: comparative observational studyBMJ
OAAI
BMJIF0
OAAI分享收藏分享收藏
查看更多内容