.png){kind=icon}
返回
Pretext Tasks Selection for Multitask Self-Supervised Audio Representation Learning
.png){kind=icon}
OA
AI
DOI：10.1109/JSTSP.2022.3195430.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Through solving pretext tasks, self-supervised learning leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. In audio and speech signal processing, a wide range of features were engineered through decades of research efforts. As it turns out, learning to predict such features has proven to be a particularly relevant pretext task, leading to useful self-supervised representations which prove to be effective for downstream tasks. However, methods and common practices for combining such pretext tasks for better performance on the downstream task have not been explored and understood properly. In fact, the process relies almost exclusively on a computationally heavy experimental procedure, which becomes intractable with the increase of the number of pretext tasks. This paper introduces a method to select a group of pretext tasks among a set of candidates. The method we propose estimates calibrated weights for the partial losses corresponding to the considered pretext tasks during the self-supervised training process. The experiments conducted on automatic speech recognition, speaker and emotion recognition and instrument classification validate our approach as the groups selected and weighted with our method perform better than classic baselines, thus facilitating the selection and combination of relevant pretext-task labels for self-supervised representation learning.
Keyword:
Task analysis
Training
Speech processing
Data models
Feature extraction
Computational modeling
Self-supervised learning
Self-Supervised learning
conditional independence
audio representation learning
期刊
IF:
13.7
论文数:
1.9K
被引数:
1.1W
机构
引用论文
分享收藏分享收藏PathoFusion: An Open-Source AI Framework for Recognition of Pathomorphological Features and Mapping of Immunohistochemical Data.png)
Cancers
OAAI
CancersIF0
OAAI分享收藏
查看更多内容