返回
Sound Source Localization Inside a Structure Under Semi-Supervised Conditions
DOI:10.1109/TASLP.2023.3263776.png)
摘要
En 中文
We propose a method for applying a sound source localization (SSL) model trained on simulated data in a real-world environment, with a domain transfer (DT) model for the SSL inside a structure. The DT model transfers real data into pseudo-simulation data. The SSL model trained on the simulation data is then adapted to the real data using the DT model. Our method consists of an SSL model and a DT model. The SSL model predicts the position of a sound source inside the structure, whereas the DT model transforms the data. Because our simulation is not perfect, real data are extrapolated for use with the SSL model. However, the data transformed by the DT model are interpolated within the feature space. The outcome is that the performance of the SSL model in the real world is improved. In our study, the frequency spectra of accelerometers observed on the outer surface of the structure are the model input. The goal is to predict the position of the sound source. The SSL model is built using deep and convolutional neural networks, and the DT model is built using either an autoencoder, a deep convolutional autoencoder, or pix2pix. The two-dimensional distributions of the t-distributed Stochastic Neighbor Embedding indicate that using pix2pix as the DT model shows the best performance. Furthermore, our method's performance for SSL is improved by 57% for the classification problem and by 27% for the regression problem when compared to the case where no transformation is applied.
Keyword:
Data models
Adaptation models
Acoustics
Speech processing
Predictive models
Location awareness
Training
Sound source localization
domain transfer
acoustic-structure coupling
t-distributed stochastic neighbor embedding
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
Desempenho de crianças do ensino fundamental na solução de problemas aritméticos<A NAME="top"></A>问题的基本解决方案
GROWTH AND POTASSIUM TRANSPORT IN COMMON AND DURUM WHEAT AS AFFECTED BY ALUMINUM AND NITRITE STRESS铝和亚硝酸盐胁迫对普通小麦和杜伦小麦生长及钾转运的影响
Analysis of carbon metabolism in transgenicArabidopsis thaliana transformed with the cyanobacterial sucrose phosphate synthase gene转基因拟南芥(transgenic Arabidopsis thaliana)中蓝藻蔗糖磷酸化酶基因(cyanobacterial sucrose phosphate synthase gene)转化后的碳代谢分析

