Return
Study on Three-Dimensional Multi-source Localization Based on Optimized Deep Learning with Interpretable Analysis
DOI:10.1007/s40857-026-00386-2.png)
Abstract
En 中文
In recent years, there has been a surge focusing on advanced sound source localization methods based on deep learning. However, the black-box feature extraction mechanism impedes their optimization. This study proposes a two-step grid-free method for locating multiple sources based on deep ensemble learning and interpretable artificial intelligence (AI). In the first step, sound pressure signals received by a spherical microphone array are preprocessed into auto-power spectra, which are then fed into a classifier to count the sources. In the second step, the aforementioned signals are converted into generalized cross-correlations with phase transform (GCC-PHAT), which are then input to an ensemble regressor comprising four types of regressors for source localization. Additionally, two interpretable AI techniques, t-distributed stochastic neighbor embedding and activation maps, are employed to analyze the underlying principles of the deep learning-based method. The classifier achieves a testing accuracy of 94.59%. Compared to single-type regressors, the ensemble regressor reduces the mean localization error by up to 33.72%. The activation maps reveal that the extracted features are the middle section of the GCC-PHAT, while the influence of the two sides on localization is negligible. After trimming these sides, input data volume decreases by 72.05%, and the time per localization drops remarkably without significant loss in accuracy. These results demonstrate that the proposed method achieves three-dimensional multi-source localization with higher accuracy and lower computation cost.
Keywords:
Sound source localization
Deep learning
Interpretable AI
Computational optimization
Journal
A
IF:
1.8
Papers:
28
Citations:
544
Organization
Cited Papers
No cited papers available

