返回
SPICE: Self-Supervised Pitch Estimation
DOI:10.1109/TASLP.2020.2982285.png)
摘要
En 中文
We propose a model to estimate the fundamental frequency in monophonic audio, often referred to as pitch estimation. We acknowledge the fact that obtaining ground truth annotations at the required temporal and frequency resolution is a particularly daunting task. Therefore, we propose to adopt a self-supervised learning technique, which is able to estimate pitch without any form of supervision. The key observation is that pitch shift maps to a simple translation when the audio signal is analysed through the lens of the constant-Q transform (CQT). We design a self-supervised task by feeding two shifted slices of the CQT to the same convolutional encoder, and require that the difference in the outputs is proportional to the corresponding difference in pitch. In addition, we introduce a small model head on top of the encoder, which is able to determine the confidence of the pitch estimate, so as to distinguish between voiced and unvoiced audio. Our results show that the proposed method is able to estimate pitch at a level of accuracy comparable to fully supervised models, both on clean and noisy audio samples, although it does not require access to large labeled datasets.
Keyword:
Audio pitch estimation
unsupervised learning
convolutional neural networks
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
The effects of the age of intracerebroventricular grafts of normal preoptic area tissue upon pituitary and gonadal function in hypogonadal (HPG) mice
Neuroscience
IF0
Atomic-level dispersed catalysts for PEMFCs: Progress and future prospects用于pemfc的原子级分散催化剂: 进展和未来前景
EnergyChem
IF0
Oblique‐slip deformation in extensional terrains: A case study of the lakes Tanganyika and Malawi Rift Zones
Tectonics
IF0

