arrow
返回

Prototype Division for Self-Supervised Speaker Verification

delete2024-01-01
delete0
PRE
AI
Z
Zhenduo Zhao
Z
Zhuo Li
X
Xueshuai Zhang
W
Wenchao Wang *
P
Pengyuan Zhang
DOI:10.1109/LSP.2024.3377593delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Self-supervised learning has shown promising performance on speaker verification tasks, among which Self-DIstillation with NO labels (DINO) is currently a widely adopted framework. As one of the unsupervised deep clustering methods, the number of valid prototypes in DINO is far less than the speakers in practical applications and remains unchanged throughout the training period, leading to severe speaker confusion and performance degradation. Therefore, a strategy named prototype division (PD) is proposed to iteratively generate fine-grained prototypes in the projection space based on the converged model to separate confused categories, where new prototypes are derived from the neighborhood of the existing valid prototypes by clustering or sampling. The results on Vox1O achieve significant improvements, relatively outperforming the baseline by 31.1% without any auxiliary loss. Further experiments on CN-Celeb also show stable improvement, proving the consistency of the proposed method.
Keyword:
DINO
prototype division
self-supervised learning
speaker verification

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Intra-Abdominal Splenosis Mimicking Metastatic Cancer
err2011-03-01
err0
PREAI
errNicholas J. Short; Teresa G. Hayes; Peeyush Bhargava
err分享
err收藏
A compressive strength model for roller-compacted concrete with fly ash
err2004-02-01
err0
PREAI
errS. Tangtermsirikul; T. Kaewkhluab; P. Jitvutikrai
err分享
err收藏
err分享
err收藏
Planning future studies based on the conditional power of a meta‐analysis
err2012-07-11
err0
errOAAI
errVerena Roloff; Julian P.T. Higgins; Alex J. Sutton
err分享
err收藏
Tumorigenicity of Methyl-n-Propylnitrosamine in Syrian Golden Hamsters2
err1974-02-01
err0
PREAI
errParviz Pour; Friedrich W. Krüger; Antonio Cardesa; Jürgen Althoff; Ulrich Mohr
err分享
err收藏
学者 查看更多内容