arrow
Return

Quantifying prediction uncertainties in automatic speaker verification systems

delete2025-06-05
delete0
delete
OA
AI
M
M. Q. Jing *
V
Vidhyasaharan Sethu
B
Beena Ahmed
K
Kong Aik Lee
DOI:10.1016/j.csl.2025.101806delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
For modern automatic speaker verification (ASV) systems, explicitly quantifying the confidence for each prediction strengthens the system's reliability by indicating in which case the system is with trust. However, current paradigms do not take this into consideration. We thus propose to express confidence in the prediction by quantifying the uncertainty in ASV predictions. This is achieved by developing a novel Bayesian framework to obtain a score distribution for each input. The mean of the distribution is used to derive the decision while the spread of the distribution represents the uncertainty arising from the plausible choices of the model parameters. To capture the plausible choices, we sample the probabilistic linear discriminant analysis (PLDA) back-end model posterior through Hamiltonian Monte-Carlo (HMC) and approximate the embedding model posterior through stochastic Langevin dynamics (SGLD) and Bayes-bybackprop. Given the resulting score distribution, a further quantification and decomposition of the prediction uncertainty are achieved by calculating the score variance, entropy, and mutual information. The quantified uncertainties include the aleatoric uncertainty and epistemic uncertainty (model uncertainty). We evaluate them by observing how they change while varying the amount of training speech, the duration, and the noise level of testing speech. The experiments indicate that the behaviour of those quantified uncertainties reflects the changes we made to the training and testing data, demonstrating the validity of the proposed method as a measure of uncertainty.
Keywords:
Speaker verification
PLDA
Uncertainty
Hamiltonian Monte-Carlo
Stochastic gradient Langevin dynamics
Bayes-by-backprop
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Computer Speech and Language
IF:
3.4
Papers:
1.5K
Citations:
2.6K

Organization

T
the university of new south wales
Scholars:
589
Papers: 305
Citations: 1
T
The Hong Kong Polytechnic University
Scholars:
5.1K
Papers: 3.0K
Citations: 17