arrow
返回

Deep Learning Aided Sound Source Localization: A Nonsynchronous Measurement Approach

delete2023-01-01
delete1
PRE
AI
G
Guitong Chen
L
Long Chen
W
Weize Sun
Q
Qiang Li *
L
Lei Huang
DOI:10.1109/TIM.2023.3273657delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Nonsynchronous measurement (NSM) is able to improve the spatial resolution of beamforming and localization accuracy at the cost of longer recording time. This trade-off can be tolerated in various applications of sound source localization (SSL), such as machine fault diagnosis. Therefore, the NSM is a promising localization technique. For stationary acoustic field, the state-of-the-art NSM methods can well localize the stationary sources. However, when the sound sources are nonstationary, these conventional NSM algorithms fail to work effectively. In this work, we propose deep-learning-aided NSM (DL-NSM) to address the nonstationary source localization. Similar to the conventional NSM methods, the DL-NSM utilizes the diagonal blocks of an incomplete covariance matrix of the NSM to determine the nondiagonal elements of this matrix but differs in the fact that the DL-NSM can achieve the approximation to the covariance matrix of the corresponding synchronous measurement (SM). In the corresponding SM, a prototype array with a larger size and denser array elements is utilized to localize the sound sources, i.e., the covariance matrix of the corresponding SM can give the correlations of all array elements. This nonlinear approximation of the covariance matrix in the proposed DL-NSM can be learned by the proper training procedure. Therefore, the correlations of the NSM could be recovered, and the array aperture might be expanded, providing high-resolution localization. The simulation and experiment validate the superiority of the proposed DL-NSM.
Keyword:
Covariance matrices
Location awareness
Optimization
Microphone arrays
Time measurement
Prototypes
Eigenvalues and eigenfunctions
Covariance matrix completion
deep learning (DL)
Index Terms
nonstationary sound source localization (SLL)

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
引用论文

引用论文

Recommended surgery of Kaposi’s sarcoma nodules
err2014-10-20
err0
PREAI
errAthanasia Tourlaki; Monica Bellinvia; Lucia Brambilla
err分享
err收藏
Nyquist-Shannon sampling theorem applied to refinements of the atomic pair distribution function
err2011-10-18
err78
errOAAI
errFarrow, Christopher L.; Shaw, Margaret; Kim, Hyunjeong; Juhas, Pavol; Billinge, Simon J. L.
err分享
err收藏
Source localization and beamforming
err2002-03-01
err404
PREAI
errChen, JC; Yao, K; Hudson, RE
err分享
err收藏
err分享
err收藏
Compressive Creep Prediction of Corundum-Mullite Refractories Based on BP Neural Network
err2019-11-01
err0
errOAAI
errLina Deng; Shuai Yi; Luju Zeng; Fei Xue; Chuancai Pan; Guowei Lin; Yueqiang Liu; Hang Zhang; Xiaochen Liu; Jinli Xie
err分享
err收藏
学者 查看更多内容