arrow
Return

Prototype Division for Self-Supervised Speaker Verification

delete2024-01-01
delete0
PRE
AI
Z
Zhenduo Zhao
Z
Zhuo Li
X
Xueshuai Zhang
W
Wenchao Wang *
P
Pengyuan Zhang
DOI:10.1109/LSP.2024.3377593delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Self-supervised learning has shown promising performance on speaker verification tasks, among which Self-DIstillation with NO labels (DINO) is currently a widely adopted framework. As one of the unsupervised deep clustering methods, the number of valid prototypes in DINO is far less than the speakers in practical applications and remains unchanged throughout the training period, leading to severe speaker confusion and performance degradation. Therefore, a strategy named prototype division (PD) is proposed to iteratively generate fine-grained prototypes in the projection space based on the converged model to separate confused categories, where new prototypes are derived from the neighborhood of the existing valid prototypes by clustering or sampling. The results on Vox1O achieve significant improvements, relatively outperforming the baseline by 31.1% without any auxiliary loss. Further experiments on CN-Celeb also show stable improvement, proving the consistency of the proposed method.
Keywords:
DINO
prototype division
self-supervised learning
speaker verification

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

errShare
errSave
Diaziquone given as a continuous infusion is an active agent for relapsed adult acute nonlymphocytic leukemia
err1986-01-01
err0
errOAAI
errEJ Lee; DA Van Echo; MJ Egorin; MS Nayar; P Shulman; CA Schiffer
errShare
errSave
Intra-Abdominal Splenosis Mimicking Metastatic Cancer
err2011-03-01
err0
PREAI
errNicholas J. Short; Teresa G. Hayes; Peeyush Bhargava
errShare
errSave
A compressive strength model for roller-compacted concrete with fly ash
err2004-02-01
err0
PREAI
errS. Tangtermsirikul; T. Kaewkhluab; P. Jitvutikrai
errShare
errSave
errShare
errSave
Planning future studies based on the conditional power of a meta‐analysis
err2012-07-11
err0
errOAAI
errVerena Roloff; Julian P.T. Higgins; Alex J. Sutton
errShare
errSave
Tumorigenicity of Methyl-n-Propylnitrosamine in Syrian Golden Hamsters2
err1974-02-01
err0
PREAI
errParviz Pour; Friedrich W. Krüger; Antonio Cardesa; Jürgen Althoff; Ulrich Mohr
errShare
errSave
researcher View more