arrow
返回

Sound Source Localization Inside a Structure Under Semi-Supervised Conditions

delete2023-01-01
delete3
delete
OA
AI
S
Shunsuke Kita *
Y
Yoshinobu Kajikawa
DOI:10.1109/TASLP.2023.3263776delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a method for applying a sound source localization (SSL) model trained on simulated data in a real-world environment, with a domain transfer (DT) model for the SSL inside a structure. The DT model transfers real data into pseudo-simulation data. The SSL model trained on the simulation data is then adapted to the real data using the DT model. Our method consists of an SSL model and a DT model. The SSL model predicts the position of a sound source inside the structure, whereas the DT model transforms the data. Because our simulation is not perfect, real data are extrapolated for use with the SSL model. However, the data transformed by the DT model are interpolated within the feature space. The outcome is that the performance of the SSL model in the real world is improved. In our study, the frequency spectra of accelerometers observed on the outer surface of the structure are the model input. The goal is to predict the position of the sound source. The SSL model is built using deep and convolutional neural networks, and the DT model is built using either an autoencoder, a deep convolutional autoencoder, or pix2pix. The two-dimensional distributions of the t-distributed Stochastic Neighbor Embedding indicate that using pix2pix as the DT model shows the best performance. Furthermore, our method's performance for SSL is improved by 57% for the classification problem and by 27% for the regression problem when compared to the case where no transformation is applied.
Keyword:
Data models
Adaptation models
Acoustics
Speech processing
Predictive models
Location awareness
Training
Sound source localization
domain transfer
acoustic-structure coupling
t-distributed stochastic neighbor embedding

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

K
Kansai University
学者数:
1.8K
论文数: 1.5K
被引数: 0
引用论文

引用论文

A unifying view on dataset shift in classification关于分类中数据集移位的统一观点
err2012-01-01
err611
PREAI
errMoreno-Torres, Jose G.; Raeder, Troy; Alaiz-Rodriguez, Rocio; Chawla, Nitesh V.; Herrera, Francisco
err分享
err收藏
Multiple ocular impairment in a patient affected by Waldenström's macroglobulinaemia
err1996-08-01
err0
PREAI
errGiovanna Leone; Vincenzo Parisi; Angelita Rebecchi; Cesare Guinetti; Riccardo Neuschuler
err分享
err收藏
A survey of transfer learning迁移学习研究综述
err2016-05-28
err0
errOAAI
errKarl Weiss; Taghi M. Khoshgoftaar; DingDing Wang
err分享
err收藏
学者 查看更多内容