.png){kind=icon}
返回
Robust Speaker Localization Guided by Deep Learning-Based Time-Frequency Masking
.png){kind=icon}
OA
AI
DOI：10.1109/TASLP.2018.2876169.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep learning-based time-frequency (T-F) masking has dramatically advanced monaural (single-channel) speech separation and enhancement. This study investigates its potential for direction of arrival (DOA) estimation in noisy and reverberant environments. We explore ways of combining T-F masking and conventional localization algorithms, such as generalized cross correlation with phase transform, as well as newly proposed algorithms based on steered-response SNR and steering vectors. The key idea is to utilize deep neural networks (DNNs) to identify speech dominant T-F units containing relatively clean phase for DOA estimation. Our DNN is trained using only monaural spectral information, and this makes the trained model directly applicable to arrays with various numbers of microphones arranged in diverse geometries. Although only monaural information is used for training, experimental results show strong robustness of the proposed approach in new environments with intense noise and room reverberation, out-performing traditional DOA estimation methods by large margins. Our study also suggests that the ideal ratio mask and its variants remain effective training targets for robust speaker localization.
Keyword:
GCC-PHAT
steered-response power
time-frequency masking
robust speaker localization
deep neural networks
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
分享收藏Cell-wide analysis of protein thermal unfolding reveals determinants of thermostability.png)
Science
ScienceIF0
PREAI
分享收藏An analysis of environment, microphone and data simulation mismatches in robust speech recognitionOAAI
OAAI分享收藏
查看更多内容