arrow
返回

Multiple Sound Source Localization in Three Dimensions Using Convolutional Neural Networks and Clustering Based Post-Processing

delete2022-01-01
delete0
delete
OA
AI
S
Saulius Sakavičius
A
Artūras Serackis
V
Vytautas Abromavičius *
DOI:10.1109/ACCESS.2022.3225968delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sound source localization methods are successfully applied for various estimation tasks, such as tracking and detecting objects, aiming cameras, and navigating robots. However, large and usually complex distributed microphone arrays are used for three-dimensional acoustic source localization. This study proposes a convolutional neural network architecture for three-dimensional sound source localization using a single tetrahedral microphone array. A spectrum phase component of a microphone array signal was designed as the input of the model, while the output represents a three-dimensional space. The paper provides extensive experimental results of the given method on a semi-synthetic audio data set and a real-world microphone array. Furthermore, cluster-based post-processing has been shown to increase the accuracy of three-dimensional localization by more than 30%. The experimental results on a synthesized data set using the image source method showed 1.08 m localization uncertainties. The estimate of the investigated sound sources had a mean absolute error of 18.97 & DEG; and elevation error of 48.49 & DEG;. An additional advantage of the proposed method is the ability to predict the location of the sound source from a single signal analysis frame. This gives instant localization and is in line with many alternative applications. The proposed solution does not require intensive preprocessing of the audio signals and can be used as a video camera pointing system based on a microphone array. In the future, it would be relevant to investigate the localization performance of more than two sound sources, and the variable acoustic conditions could also be assessed.
Keyword:
Location awareness
Microphone arrays
Acoustics
Clustering algorithms
Direction-of-arrival estimation
Cameras
Estimation
Clustering
convolutional neural networks
microphone array
multiple sound sources
sound source localization
three-dimensional

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

V
vilnius gediminas technical university
学者数:
2.2K
论文数: 2.1K
被引数: 24
引用论文

引用论文

The expression of multidrug resistance protein in human gastrointestinal tract carcinomas
err1998-02-15
err0
errOAAI
errYuji Takebayashi; Shin-ichi Akiyama; Shoji Natsugoe; Shuichi Hokita; Kiyoshi Niwa; Masaki Kitazono; Tomoyuki Sumizawa; Ayako Tani; Tatsuhiko Furukawa; Takashi Aikou
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Current approach to the problem of nitrenium ions
err2007-10-17
err0
PREAI
errT P Simonova; V D Nefedov; M A Toropova; N F Kirillov
err分享
err收藏
学者 查看更多内容