arrow
返回

Voice Conversion Using Deep Neural Networks With Layer-Wise Generative Training

delete2014-12-01
delete189
PRE
AI
L
Ling-Hui Chen
Z
Zhen-Hua Ling *
L
Lijuan Liu
戴
戴礼荣 (Li-Rong Dai)
DOI:10.1109/TASLP.2014.2353991delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a new spectral envelope conversion method using deep neural networks (DNNs). The conventional joint density Gaussian mixture model (JDGMM) based spectral conversion methods perform stably and effectively. However, the speech generated by these methods suffer severe quality degradation due to the following two factors: 1) inadequacy of JDGMM in modeling the distribution of spectral features as well as the non-linear mapping relationship between the source and target speakers, 2) spectral detail loss caused by the use of high-level spectral features such as mel-cepstra. Previously, we have proposed to use the mixture of restricted Boltzmann machines (MoRBM) and the mixture of Gaussian bidirectional associative memories (MoGBAM) to cope with these problems. In this paper, we propose to use a DNN to construct a global non-linear mapping relationship between the spectral envelopes of two speakers. The proposed DNN is generatively trained by cascading two RBMs, which model the distributions of spectral envelopes of source and target speakers respectively, using a Bernoulli BAM (BBAM). Therefore, the proposed training method takes the advantage of the strong modeling ability of RBMs in modeling the distribution of spectral envelopes and the superiority of BAMs in deriving the conditional distributions for conversion. Careful comparisons and analysis among the proposed method and some conventional methods are presented in this paper. The subjective results show that the proposed method can significantly improve the performance in terms of both similarity and naturalness compared to conventional methods.
Keyword:
Bidirectional associative memory
deep neural network
Gaussian mixture model
restricted Boltzmann machine
spectral envelope conversion
voice conversion
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Synthesis and Crystal Structure of the New Polymorph Cu3Fe2(SeO3)6-II.
err1997-01-01
err0
errOAAI
errG. Giester; Jens Emil Vindstad; Terje Østvold; Maamar Hamdi; Suzanne Fery-Forgues; Wenjun Shi; Stenbjörn Styring; Cecilia Tommos; Kurt Warncke; Bryan R. Wood
err分享
err收藏
Establishing a Multi-Country Sickle Cell Disease Registry in Africa: Ethical Considerations
err2019-10-10
err0
errOAAI
errNchangwi Syntia Munung; Victoria Nembaware; Jantina de Vries; Daima Bukini; Furahini Tluway; Marsha Treadwell; Raphael Zozimus Sangeda; Gaston Mazandu; Mario Jonas; Vivian Paintsil; Obiageli E. Nnodu; Emmanuel Balandya; Julie Makani; Ambroise Wonkam
err分享
err收藏
err分享
err收藏
学者 查看更多内容