arrow
返回

Vocal Effort Based Speaking Style Conversion Using Vocoder Features and Parallel Learning

delete2019-01-01
delete15
delete
OA
AI
S
Shreyas Seshadri *
L
Lauri Juvela
O
Okko Räsänen
P
Paavo Alku
DOI:10.1109/ACCESS.2019.2895923delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Speaking style conversion (SSC) is the technology of converting natural speech signals from one style to another. In this study, we aim to provide a general SSC system for converting styles with varying vocal effort and focus on normal-to-Lombard conversion as a case study of this problem. We propose a parametric approach that uses a vocoder to extract speech features. These features are mapped using parallel machine learning models from utterances spoken in normal style to the corresponding features of Lombard speech. Finally, the mapped features are converted to a Lombard speech waveform with the vocoder. A total of three vocoders (GlottDNN, STRAIGHT, and Pulse model in log domain (PML)) and three machine learning mapping methods (standard GMM, Bayesian GMM, and feed-forward DNN) were compared in the proposed normal-to-Lombard style conversion system. The conversion was evaluated using two subjective listening tests measuring perceived Lombardness and quality of the converted speech signals, and by using an instrumental measure called Speech Intelligibility in Bits (SIIB) for speech intelligibility evaluation under various noise levels. The results of the subjective tests show that the system is able to convert normal speech into Lombard speech and that there is a trade-off between quality and Lombardness of the mapped utterances. The G1ottDNN and PML stand out as the best vocoders in terms of quality and Lombardness, respectively, whereas the DNN is the best mapping method in terms of Lombardness. PML with the standard GMM seems to give a good compromise between the two attributes. The SIIB experiments indicate that intelligibility of converted speech compared to that of normal speech improved in noisy conditions most effectively when DNN mapping was used with STRAIGHT and PML.
Keyword:
Bayesian GMM
DNN
GlottDNN
Lombard speech
pulse model in log domain
speaking style conversion
vocal effort
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

A
Aalto University
学者数:
1.6W
论文数: 1.5W
被引数: 2.1W
引用论文

引用论文

err分享
err收藏
Fragment Screening and Fast Micromolar Detection on a Benchtop NMR Spectrometer Boosted by Photoinduced Hyperpolarization
err2023-08-24
err0
errOAAI
errGabriela R. Stadler; Takuya F. Segawa; Matthias Bütikofer; Venita Decker; Sandra Loss; Barbara Czarniecki; Felix Torres; Roland Riek
err分享
err收藏
‘Henderson's’ relief of eyelid retraction revisited
errEye
IF0
err1995-07-01
err0
errOAAI
errJane M Olver; Peter Fells
err分享
err收藏
Autophagie et destruction des lymphocytes T CD4 par le VIH-1
err2006-08-15
err0
errOAAI
errLucile Espert; Mélanie Denizot; Marina Grimaldi; Véronique Robert-Hebmann; Bernard Gay; Mihayl Varbanov; Patrice Codogno; Martine Biard-Piechaczyk
err分享
err收藏
学者 查看更多内容