arrow
返回

Unsupervised Music Source Separation Using Differentiable Parametric Source Models

delete2023-01-01
delete9
delete
OA
AI
K
Kilian Schulze-Forster
G
Gaël Richard *
L
Liam Kelley
C
Clement S. J. Doire
R
Roland Badeau
DOI:10.1109/TASLP.2023.3252272delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Supervised deep learning approaches to underdetermined audio source separation achieve state-of-the-art performance but require a dataset of mixtures along with their corresponding isolated source signals. Such datasets can be extremely costly to obtain for musical mixtures. This raises a need for unsupervised methods. We propose a novel unsupervised model-based deep learning approach to musical source separation. Each source is modelled with a differentiable parametric source-filter model. A neural network is trained to reconstruct the observed mixture as a sum of the sources by estimating the source models' parameters given their fundamental frequencies. At test time, soft masks are obtained from the synthesized source signals. The experimental evaluation on a vocal ensemble separation task shows that the proposed method outperforms learning-free methods based on nonnegative matrix factorization and a supervised deep learning baseline. Integrating domain knowledge in the form of source models into a data-driven method leads to high data efficiency: the proposed approach achieves good separation quality even when trained on less than three minutes of audio. This work makes powerful deep learning based separation usable in scenarios where training data with ground truth is expensive or nonexistent.
Keyword:
Source separation
Music
Training
Deep learning
Task analysis
Speech processing
Recording
Unsupervised learning
audio source separation
signal processing
model-based
deep learning

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

I
imt - institut mines-telecom
学者数:
7.4K
论文数: 6.4K
被引数: 5
I
institut polytechnique de paris
学者数:
1.3W
论文数: 1.0W
被引数: 6
引用论文

引用论文

Chromosomes染色体
err
IF0
err1996-01-01
err0
PREAI
errM. S. Clark; W. J. Wall
err分享
err收藏
Musical Source Separation An introduction
err2019-01-01
err60
errOAAI
errCano, Estefania; FitzGerald, Derry; Liutkus, Antoine; Plumbley, Mark D.; Stoeter, Fabian-Robert
err分享
err收藏
学者 查看更多内容