arrow
返回

Multimodal System for Audio Scene Source Counting and Analysis

delete2022-01-01
delete2
delete
OA
AI
M
Michael Nigro *
S
Sridhar Krishnan
DOI:10.1109/TASLP.2022.3156795delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Audio scene analysis (ASA) is a challenging and multifaceted task in audio signal processing that uncovers information about the nature of an audio recording. Regardless of the analysis goal, a number of audio sources are observed in any audio scene. However, this consideration is usually not explored or given considerable thought in research. This work aims to demonstrate the utility of audio source counting with a novel solution consisting of a multimodal system for ASA. Both speaker counting and sound event counting techniques use deep neural networks (DNN) to predict the number of sources. We are able to present competitive results for audio source counting by achieving prediction accuracy of 46.03% and 89.57% with a margin of error of +/- 1 for speaker counting, which outperforms state-of-the-art systems for similar tasks. For sound event counting we achieve 50.55% and 86.59% prediction accuracy and accuracy with a margin of error of +/- 1, respectively, that establishes a clear baseline. Our system also demonstrates real-time aspects with an overall processing time of similar to 0.4614 s per audio recording.
Keyword:
Audio scene analysis
source counting
speaker count estimation

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

T
Toronto Metropolitan University
学者数:
6.0K
论文数: 7.0K
被引数: 6.4K
引用论文

引用论文

Demonstration of AlN Schottky Barrier Diodes With Blocking Voltage Over 1 kV
err2017-09-01
err0
PREAI
errHouqiang Fu; Izak Baranowski; Xuanqi Huang; Hong Chen; Zhijian Lu; Jossue Montes; Xiaodong Zhang; Yuji Zhao
err分享
err收藏
RF Filters with Periodic Passbands for Sparse Fourier Transform-Based Spectrum Sensing
err2018-10-01
err0
PREAI
errRuochen Lu; Tomas Manzaneque; Yansong Yang; Jin Zhou; Haitham Hassanieh; Songbin Gong
err分享
err收藏
err分享
err收藏
A Comprehensive Review of Polyphonic Sound Event Detection
err2020-01-01
err31
errOAAI
errChan, T. K.; Chin, Cheng Siong
err分享
err收藏
Structural, morphological and magnetic properties of Ni–Cu–Co ferrites by the Sm3+ ions substitution
err2020-05-30
err0
PREAI
errLichao Yu; Aimin Sun; Nanzhaxi Suo; Zhuo Zuo; Xiqian Zhao; Wei Zhang
err分享
err收藏
学者 查看更多内容