返回
MASS: Multi-task anthropomorphic speech synthesis framework
DOI:10.1016/j.csl.2021.101243.png)
摘要
En 中文
Text-to-Speech (TTS) synthesis plays an important role in human-computer interaction. Currently, most TTS technologies focus on the naturalness of speech, namely, making the speeches sound like humans. However, the key tasks of the expression of emotion and the speaker identity are ignored, which limits the application scenarios of TTS synthesis technology. To make the synthesized speech more realistic and expand the application scenarios, we propose a multi-task anthropomorphic speech synthesis framework (MASS), which can synthesize speeches from text with specified emotion and speaker identity. The MASS framework consists of a base TTS module and two novel voice conversion modules: the emotional voice conversion module and the speaker voice conversion module. We propose deep emotion voice conversion model (DEVC) and deep speaker voice conversion model (DSVC) based on convolution residual networks. It solves the problem of feature loss during voice conversion. The model trainings are independent of parallel datasets, and are capable of many-to many voice conversion. In the emotional voice conversion, speaker voice conversion experiments, as well as the multi-task speech synthesis experiments, experimental results show DEVC and DSVC convert speech effectively. The quantitative and qualitative evaluation results of multi-task speech synthesis experiments show MASS can effectively synthesis speech with specified text, emotion and speaker identity . (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Text-to-speech
Emotional voice conversion
Speaker voice conversion
Convolution residual network
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
C
IF:
3.4
论文数:
1.5K
被引数:
2.6K
机构
引用论文
Effects of 4-Chloro-2-methylphenoxypropionate (an Auxin Analogue) on Plasma Membrane ATPase Activity in Herbicide-Resistant and Herbicide-Susceptible Biotypes ofStellaria mediaL.4-氯-2-甲基苯氧基丙酸(一种生长素类似物)对除草剂抗性及除草剂敏感型繁缕L.质膜ATP酶活性的影响

