arrow
返回

ACVAE-VC: Non-Parallel Voice Conversion With Auxiliary Classifier Variational Autoencoder

delete2019-09-01
delete78
PRE
AI
K
Katneoka, Hirokazu *
T
Takuhiro Kaneko
K
Kou Tanaka
N
Nobukatsu Hojo
DOI:10.1109/TASLP.2019.2917232delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes a non-parallel voice conversion (VC) method using a variant of the conditional variational autoencoder (VAE) called an auxiliary classifier VAE. The proposed method has two key features. First, it adopts fully convolutional architectures to construct the encoder and decoder networks so that the networks can learn conversion rules that capture the time dependencies in the acoustic feature sequences of source and target speech. Second, it uses information-theoretic regularization for the model training to ensure that the information in the attribute class label will not he lost in the conversion process. With regular conditional VAEs, the encoder and decoder are free to ignore the attribute class label input. This can be problematic since in such a situation, the attribute class label will have little effect on controlling the voice characteristics of input speech at test time. Such situations can he avoided by introducing an auxiliary classifier and training the encoder and decoder so that the attribute classes of the decoder outputs are correctly predicted by the classifier. We also present several ways to convert the feature sequence of input speech using the trained encoder and decoder and compare them in terms of audio quality through objective and subjective evaluations. We confirmed experimentally that the proposed method outperformed baseline non-parallel VC systems and performed comparably to an open-source parallel VC system trained using a parallel corpus in a speaker identity conversion task.
Keyword:
Voice conversion (VC)
variational autoencoder (VAE)
non-parallel VC
auxiliary classifier VAE (ACVAE)
fully convolutional network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

暂无机构信息
引用论文

引用论文

Fragment Screening and Fast Micromolar Detection on a Benchtop NMR Spectrometer Boosted by Photoinduced Hyperpolarization
err2023-08-24
err0
errOAAI
errGabriela R. Stadler; Takuya F. Segawa; Matthias Bütikofer; Venita Decker; Sandra Loss; Barbara Czarniecki; Felix Torres; Roland Riek
err分享
err收藏
Quantitative Contributions of the Muscles of the Tongue, Floor-of-Mouth, Jaw, and Velum to Tongue-to-Palate Pressure Generation
err2008-08-01
err0
PREAI
errPhyllis M. Palmer; Debra M. Jaffe; Timothy M. McCulloch; Eileen M. Finnegan; Douglas J. Van Daele; Erich S. Luschei
err分享
err收藏
err分享
err收藏
Mamiellophyceae shift in seasonal predominance in the Baltic Sea
err2019-08-22
err0
errOAAI
errM Majaneva; S Enberg; R Autio; J Blomster; JM Rintala
err分享
err收藏
学者 查看更多内容