返回
Audio Mixing Inversion via Embodied Self-supervised Learning
DOI:10.1007/s11633-023-1441-9.png)
摘要
En 中文
Audio mixing is a crucial part of music production. For analyzing or recreating audio mixing, it is of great importance to conduct research on estimating mixing parameters used to create mixdowns from music recordings, i.e., audio mixing inversion. However, approaches of audio mixing inversion are rarely explored. A method of estimating mixing parameters from raw tracks and a stereo mixdown via embodied self-supervised learning is presented. In this work, several commonly used audio effects including gain, pan, equalization, reverb, and compression, are taken into consideration. This method is able to learn an inference neural network that takes a stereo mixdown and the raw audio sources as input and estimate mixing parameters used to create the mixdown by iteratively sampling and training. During the sampling step, the inference network predicts a set of mixing parameters, which is sampled and fed to an audio-processing framework to generate audio data for the training step. During the training step, the same network used in the sampling step is optimized with the sampled data generated from the sampling step. This method is able to explicitly model the mixing process in an interpretable way instead of using a black-box neural network model. A set of objective measures are used for evaluation. The experimental results show that this method has better performance than current state-of-the-art methods.
Keyword:
Audio mixing inversion
intelligent audio mixing
self-supervised learning
audio signal processing
deep learning
期刊
IF:
8.7
论文数:
304
被引数:
882
机构
引用论文
Multiangle Social Network Recommendation Algorithms and Similarity Network Evaluation多角度社会网络推荐算法与相似性网络评估
Characterization, identification and antibiogram studies of endophytic bacteria from cowpea [Vigna unguiculata (L.) Walp]内生细菌的表征、鉴定及抗菌谱研究(来自豇豆 [Vigna unguiculata (L.) Walp])

