arrow
Return

Audio Source Separation Using Variational Autoencoders and Weak Class Supervision

delete2019-09-01
delete21
delete
OA
AI
E
Ertuğ Karamatlı *
A
Ali Taylan Cemgil
S
Serap Kırbız
DOI:10.1109/LSP.2019.2929440delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this letter, we propose a source separation method that is trained by observing the mixtures and the class labels of the sources present in the mixture without any access to isolated sources. Since our method does not require source class labels for every time-frequency bin but only a single label for each source constituting the mixture signal, we call this scenario as weak class supervision. We associate a variational autoencoder (VAE) with each source class within a non negative (compositional) model. Each VAE provides a prior model to identify the signal from its associated class in a sound mixture. After training the model on mixtures, we obtain a generative model for each source class and demonstrate our method on one-second mixtures of utterances of digits from 0 to 9. We show that the separation performance obtained by source class supervision is as good as the performance obtained by source signal supervision.
Keywords:
Weak Supervision
Source Separation
Variational Autoencoders
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

B
Bogazici University
Scholars:
4.1K
Papers: 3.9K
Citations: 27