arrow
返回

Audio Mixing Inversion via Embodied Self-supervised Learning

delete2024-01-15
delete1
PRE
AI
H
H. Harry Zhou
冯
冯钰 (Feng Yu)
X
Xihong Wu *
DOI:10.1007/s11633-023-1441-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Audio mixing is a crucial part of music production. For analyzing or recreating audio mixing, it is of great importance to conduct research on estimating mixing parameters used to create mixdowns from music recordings, i.e., audio mixing inversion. However, approaches of audio mixing inversion are rarely explored. A method of estimating mixing parameters from raw tracks and a stereo mixdown via embodied self-supervised learning is presented. In this work, several commonly used audio effects including gain, pan, equalization, reverb, and compression, are taken into consideration. This method is able to learn an inference neural network that takes a stereo mixdown and the raw audio sources as input and estimate mixing parameters used to create the mixdown by iteratively sampling and training. During the sampling step, the inference network predicts a set of mixing parameters, which is sampled and fed to an audio-processing framework to generate audio data for the training step. During the training step, the same network used in the sampling step is optimized with the sampled data generated from the sampling step. This method is able to explicitly model the mixing process in an interpretable way instead of using a black-box neural network model. A set of objective measures are used for evaluation. The experimental results show that this method has better performance than current state-of-the-art methods.
Keyword:
Audio mixing inversion
intelligent audio mixing
self-supervised learning
audio signal processing
deep learning

期刊

Machine Intelligence Research 封面图
Machine Intelligence Research
IF:
8.7
论文数:
304
被引数:
882

机构

C
Central Conservatory of Music
学者数:
18
论文数: 8
被引数: 0
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
err分享
err收藏
Henoch-SchöNlein Purpura in Adults成人过敏性紫癜(Henoch-Schönlein Purpura)
err2008-04-01
err0
errOAAI
errMaría José López Meiller; Javier Alberto Cavallasca; María del Rosario Maliandi; Gustavo Guillermo Nasswetter
err分享
err收藏
学者 查看更多内容