.png){kind=icon}
返回
Decoding Knowledge Transfer for Neural Text-to-Speech Training
.png){kind=icon}
OA
AI
DOI：10.1109/TASLP.2022.3171974.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Neural end-to-end text-to-speech (TTS) is superior to conventional statistical methods in many ways. However, the exposure bias problem, that arises from the mismatch between the training and inference process in autoregressive models, remains an issue. It often leads to performance degradation in face of out-of-domain test data. To address this problem, we study a novel decoding knowledge transfer strategy, and propose a multi-teacher knowledge distillation (MT-KD) network for Tacotron2 TTS model. The idea is to pre-train two Tacotron2 TTS teacher models in teacher forcing and scheduled sampling modes, and transfer the pre-trained knowledge to a student model that performs free running decoding. We show that the MT-KD network provides an adequate platform for neural TTS training, where the student model learns to emulate the behaviors of the two teachers, at the same time, minimizing the mismatch between training and run-time inference. Experiments on both Chinese and English data show that MT-KD system consistently outperforms the competitive baselines in terms of naturalness, robustness and expressiveness for in-domain and out-of-domain test data. Furthermore, we show that knowledge distillation outperforms adversarial learning and data augmentation in addressing the exposure bias problem.
Keyword:
Decoding
Training
Speech processing
Knowledge transfer
Data models
Computational modeling
Adversarial machine learning
Autoregressive model
end-to-end TTS
exposure bias
knowledge distillation
knowledge transfer
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
Genotype-Phenotype Associations in Patients With Type-1, Type-2, and Atypical NF1 MicrodeletionsOAAI
OAAI分享收藏
AN ETHOLOGICAL INTERPRETATION OF ZOOPHYCOS BASED ON PERMIAN RECORDS FROM SOUTH CHINA AND SOUTHEASTERN AUSTRALIA基于中国南部和澳大利亚东南部二叠纪记录的Zoophycos的动物行为学解释.png)
PALAIOS
PALAIOSIF0
PREAI
分享收藏Bioanalytical Approaches for Characterizing Catabolism of Antibody–Drug ConjugatesBioanalysis
BioanalysisIF0
PREAI
分享收藏分享收藏
查看更多内容