.png){kind=icon}
Return
Self-supervised Contrastive Learning for Content-Centric Speech Representation
.png){kind=icon}
PRE
AI
DOI：10.1007/978-981-95-2725-0_1.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Self-supervised learning (SSL) speech models have achieved remarkable performance across various tasks, with the learned representations often exhibiting a high degree of generality and applicability to multiple downstream tasks. However, these representations contain both speech content and some paralinguistic information, which may be redundant for content-focused tasks. Decoupling this redundant information is challenging. To address this issue, we propose a Self-Supervised Contrastive Representation Learning method (SSCRL), which effectively disentangles paralinguistic information from speech content by aligning similar content speech representations in the feature space using self-supervised contrastive learning with pitch perturbation and speaker perturbation features. Experimental results demonstrate that the proposed method, when fine-tuned on the LibriSpeech 100-hour dataset, achieves superior performance across all content-related tasks in the SUPERB Benchmark, generally outperforming prior approaches.
Keywords:
Self-Supervised Fine-Tuning
Feature Disentanglement
Pre-trained Speech Model
Contrastive Learning
Journal
C
IF:
0
Papers:
27
Citations:
0
Organization
Cited Papers
ShareSaveShareSaveShareSaveShareSaveSCORE: Self-Supervised Correspondence Fine-Tuning for Improved Content Representations.png)
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)IF0
PREAI
ShareSaveShareSaveSelf-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering
PREAI
ShareSaveShareSave
View more