arrow
返回

Vocal-Accompaniment Compatibility Estimation Using Self-Supervised and Joint-Embedding Techniques

delete2021-01-01
delete2
delete
OA
AI
T
Takayuki Nakatsuka *
K
Kento Watanabe
Y
Yuki Koyama
M
Masahiro Hamasaki
M
Masataka Goto
S
Shigeo Morishima
DOI:10.1109/ACCESS.2021.3096819delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a learning-based method of estimating the compatibility between vocal and accompaniment audio tracks, i.e., how well they go with each other when played simultaneously. This task is challenging because it is difficult to formulate hand-crafted rules or construct a large labeled dataset to perform supervised learning. Our method uses self-supervised and joint-embedding techniques for estimating vocal-accompaniment compatibility. We train vocal and accompaniment encoders to learn a joint-embedding space of vocal and accompaniment tracks, where the embedded feature vectors of a compatible pair of vocal and accompaniment tracks lie close to each other and those of an incompatible pair lie far from each other. To address the lack of large labeled datasets consisting of compatible and incompatible pairs of vocal and accompaniment tracks, we propose generating such a dataset from songs using singing voice separation techniques, with which songs are separated into pairs of vocal and accompaniment tracks, and then original pairs are assumed to be compatible, and other random pairs are not. We achieved this training by constructing a large dataset containing 910,803 songs and evaluated the effectiveness of our method using ranking-based evaluation methods.
Keyword:
Estimation
Mashups
Training data
Training
Target tracking
Transforms
Task analysis
Vocal-accompaniment compatibility
metric learning
music signal processing
music information retrieval

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

W
Waseda University
学者数:
1.0W
论文数: 8.7K
被引数: 8.3K
引用论文

引用论文

Can CD34 discriminate between benign and malignant hepatocytic lesions in fine-needle aspirates and thin core biopsies?
err2000-11-10
err0
errOAAI
errW. Bastiaan de Boer; Amanda Segal; Felicity A. Frost; Gregory F. Sterrett
err分享
err收藏
A Technique for Measuring Petal Gloss, with Examples from the Namaqualand Flora
err2012-01-10
err0
errOAAI
errHeather M. Whitney; Sean A. Rands; Nick J. Elton; Allan G. Ellis
err分享
err收藏
Proteome Characteristics of Non-Alcoholic Steatohepatitis Liver Tissue and Associated Hepatocellular Carcinomas
err2017-02-17
err0
errOAAI
errAnna Kakehashi; Vasily Stefanov; Naomi Ishii; Takahiro Okuno; Hideki Fujii; Kazuaki Kawai; Norifumi Kawada; Hideki Wanibuchi
err分享
err收藏
err分享
err收藏
Demonstration of AlN Schottky Barrier Diodes With Blocking Voltage Over 1 kV
err2017-09-01
err0
PREAI
errHouqiang Fu; Izak Baranowski; Xuanqi Huang; Hong Chen; Zhijian Lu; Jossue Montes; Xiaodong Zhang; Yuji Zhao
err分享
err收藏
学者 查看更多内容