.png){kind=icon}
返回
Multi-microphone Complex Spectral Mapping for Utterance-wise and Continuous Speech Separation
.png){kind=icon}
OA
AI
DOI：10.1109/TASLP.2021.3083405.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We propose multi-microphone complex spectral mapping, a simple way of applying deep learning for time-varying non-linear beamforming, for speaker separation in reverberant conditions. We aim at both speaker separation and dereverberation. Our study first investigates offline utterance-wise speaker separation and then extends to block-online continuous speech separation (CSS). Assuming a fixed array geometry between training and testing, we train deep neural networks (DNN) to predict the real and imaginary (RI) components of target speech at a reference microphone from the RI components of multiple microphones. We then integrate multi-microphone complex spectral mapping with minimum variance distortionless response (MVDR) beamforming and post-filtering to further improve separation, and combine it with frame-level speaker counting for block-online CSS. Although our system is trained on simulated room impulse responses (RIR) based on a fixed number of microphones arranged in a given geometry, it generalizes well to a real array with the same geometry. State-of-the-art separation performance is obtained on the simulated two-talker SMS-WSJ corpus and the real-recorded LibriCSS dataset.
Keyword:
Geometry
Array signal processing
Speech processing
Microphone arrays
Covariance matrices
Deep learning
Training
Complex spectral mapping
speaker separation
microphone array processing
deep learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
Baculovirus Infection Triggers a Shift from Amino Acid Starvation-Induced Autophagy to Apoptosis.png)
PLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏Shape analysis of the neostriatum in frontotemporal lobar degeneration, Alzheimer's disease, and controlsNeuroImage
NeuroImageIF0
PREAI
分享收藏分享收藏分享收藏ChemInform Abstract: Thermodynamic Modelling of the Mg—Ge—Si, Mg—Ge—Sn, Mg—Pb—Si and Mg—Pb—Sn Systems.ChemInform
ChemInformIF0
PREAI
分享收藏
查看更多内容