arrow
返回

Maximum Likelihood Nonlinear Transformations Based on Deep Neural Networks

delete2016-11-01
delete5
PRE
AI
X
Xiaodong Cui *
V
Vaibhava Goel
DOI:10.1109/TASLP.2016.2594255delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature transformations are commonly used in speech recognition to account for distribution mismatches between the source and target domains (also referred to as covariate shift). Linear (affine) or piecewise linear transformations are typically considered. In this paper, we present deep neural network (DNN) based nonlinear feature transformations estimated under the maximum likelihood criterion. We use the hidden Markov model (HMM) to model speech feature sequences and features in each HMM state assume a Gaussian mixture model (GMM) distribution. The network is pre-trained close to a linear transformation followed by a fine-tuning using the gradient descent algorithm. Due to the nonlinearity, the gradients and the partition functions of GMM-HMM state distributions are evaluated using the Monte Carlo (MC) method based on importance sampling. In addition, a deep stacked architecture is proposed to hierarchically build a DNN as a series of sub-networks with each representing a nonlinear transformation itself, which can be learned using a block-wise learning strategy. Applications of the proposed nonlinear transformations in speaker/environment adaptation and acoustic modeling in large vocabulary continuous speech recognition tasks show its superior performance over the widely-used constrained maximum likelihood linear regression (CMLLR).
Keyword:
Automatic speech recognition
deep neural network
importance sampling
monte Carlo
nonlinear transformation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

I
international business machines (ibm)
学者数:
5.7K
论文数: 4.5K
被引数: 4
引用论文

引用论文

Structural characterization of eutectic aqueous NaCl solutions under variable temperature and pressure conditions
err2015-01-01
err0
errOAAI
errA.-A. Ludl; L. E. Bove; A. M. Saitta; M. Salanne; T. C. Hansen; C. L. Bull; R. Gaal; S. Klotz
err分享
err收藏
Autocatalytic phase separation and graded co-continuous morphology generated by photocuring
err2006-01-01
err0
PREAI
errHideyuki Nakanishi; Nobuhiro Namikawa; Tomohisa Norisuye; Qui Tran-Cong-Miyata
err分享
err收藏
The Market for Corporate Control and Accounting Conservatism
err2014-01-01
err0
PREAI
errJeffrey L. Callen; Yuyan Guan; Jiaping Qiu
err分享
err收藏
Charge-Transfer and Energy-Transfer Processes in π-Conjugated Oligomers and Polymers:  A Molecular Picture
err2004-09-28
err0
PREAI
errJean-Luc Brédas; David Beljonne; Veaceslav Coropceanu; Jérôme Cornil
err分享
err收藏
学者 查看更多内容