arrow
返回

So-DAS: A Two-Step Soft-Direction-Aware Speech Separation Framework

delete2023-01-01
delete2
PRE
AI
Y
Yi Yang
Q
Qi Hu
Q
Qingwei Zhao *
P
Pengyuan Zhang
DOI:10.1109/LSP.2023.3248952delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most existing direction-aware speech separation systems lead to performance degradation when the angle difference between speakers is small due to the low spatial discrimination. To address this issue, we propose a two-step soft-direction-aware speech separation (So-DAS) framework, which consists of a direction of arrival (DOA) estimation module and a speech separation module. First, the two modules are individually optimized, and directional features (DFs) derived from ground-truth DOAs are utilized as spatial information to facilitate the separation module. Next, the two modules are cascaded and optimized with only separation loss, and the DFs are generated using the estimator outputs. By this means, the consistency between the two modules is strengthened, and thus spatial cues that are more beneficial to the separation task can be exploited by the network itself. The experimental results show that compared to the baselines, DFs extracted by our proposed method provides clearer superiority, especially when the angle difference between speakers is small. In addition, our approach yields a state-of-the-art word error rate of 3.4% on the real-recorded utterance-wise LibriCSS dataset.
Keyword:
Direction-of-arrival estimation
Particle separators
Training data
Training
Signal to noise ratio
Reflection
Optimization
Multi-channel speech separation
directional feature
deep learning

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Phase-Structural State of τ-MnAl(Ga) Alloys Prepared at Different Cooling Rates
err2024-08-09
err0
PREAI
errA. S. Fortuna; N. M. Vazhinskii; K. S. Nechaev; T. A. Morozova; M. V. Gorshenkov; D. Yu. Karpenkov; E. S. Malyutina
err分享
err收藏
Sprint Ability: How Well Does Your Software Exploit Bursts in Processing Capacity?
err2016-07-01
err0
PREAI
errNathaniel Morris; Siva Meenakshi Renganathan; Christopher Stewart; Robert Birke; Lydia Chen
err分享
err收藏
Shape analysis of the neostriatum in frontotemporal lobar degeneration, Alzheimer's disease, and controls
err2010-07-01
err0
PREAI
errJeffrey Chee Leong Looi; Mark Walterfang; Martin Styner; Leif Svensson; Olof Lindberg; Per Östberg; Lisa Botes; Eva Örndahl; Phyllis Chua; Rajeev Kumar; Dennis Velakoulis; Lars-Olof Wahlund
err分享
err收藏
err分享
err收藏
学者 查看更多内容