arrow
返回

Online Spectrogram Inversion for Low-Latency Audio Source Separation

delete2020-01-01
delete10
delete
OA
AI
P
Paul Magron *
T
Tuomas Virtanen
DOI:10.1109/LSP.2020.2970310delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Audio source separation is usually achieved by estimating the short-time Fourier transform (STFT) magnitude of each source, and then applying a spectrogram inversion algorithm to retrieve time-domain signals. In particular, the multiple input spectrogram inversion (MISI) algorithm has been exploited successfully in several recent works. However, this algorithm suffers from two drawbacks, which we address in this letter. First, it has originally been introduced in a heuristic fashion: we propose here a rigorous optimization framework in which MISI is derived, thus proving the convergence of this algorithm. Besides, while MISI operates offline, we propose here an online version of MISI called oMISI, which is suitable for low-latency source separation, an important requirement for e.g., hearing aids applications. oMISI also allows one to use alternative phase initialization schemes exploiting the temporal structure of audio signals. Experiments conducted on a speech separation task show that oMISI performs as well as its offline counterpart, thus demonstrating its potential for real-time source separation.
Keyword:
Audio source separation
low-latency
online spectrogram inversion
phase recovery
sinusoidal modeling

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

U
universite federale toulouse midi-pyrenees (comue)
学者数:
8.1K
论文数: 5.9K
被引数: 6
U
universite de toulouse
学者数:
3.5W
论文数: 2.7W
被引数: 37
引用论文

引用论文

Musical Source Separation An introduction
err2019-01-01
err60
errOAAI
errCano, Estefania; FitzGerald, Derry; Liutkus, Antoine; Plumbley, Mark D.; Stoeter, Fabian-Robert
err分享
err收藏
Phase Processing for Single-Channel Speech Enhancement
err2015-03-01
err200
PREAI
errGerkmann, Timo; Krawczyk-Becker, Martin; Le Roux, Jonathan
err分享
err收藏
Phasebook and Friends: Leveraging Discrete Representations for Source Separation
err2019-05-01
err45
errOAAI
errLe Roux, Jonathan; Wichern, Gordon; Watanabe, Shinji; Sarroff, Andy; Hershey, John R.
err分享
err收藏
学者 查看更多内容