arrow
Return

Improved Frequency Modulation Features for Multichannel Distant Speech Recognition

delete2019-08-01
delete5
delete
OA
AI
I
Isidoros Rodomagoulakis *
P
Petros Maragos
DOI:10.1109/JSTSP.2019.2923372delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Frequency modulation features capture the fine structure of speech formants that constitute beneficial to the traditional energy-based cepstral features by carrying supplementary information. Improvements have been demonstrated mainly in Gaussian mixture model (GMM)-hidden Markov model (HMM) systems for small and large vocabulary tasks. Yet, they have limited applications in deep neural network (DNN)-HMM systems and distant speech recognition (DSR) tasks. Herein, we elaborate on their integration within state-of-the-art front-end schemes that include post-processing of MFCCs resulting in discriminant and speaker-adapted features of large temporal contexts. We explore: 1) multichannel demodulation schemes for multi-microphone setups; 2) richer descriptors of frequency modulations; and 3) feature transformation and combination via hierarchical deep networks. We present results for tandem and hybrid recognition with GMM and DNN acoustic models, respectively. The improved modulation features are combined efficiently with MFCCs yielding modest and consistent improvements in multichannel DSR tasks on reverberant and noisy environments, where recognition rates are far from human performance.
Keywords:
Frequency modulation features
demodulation
deep bottleneck features
distant speech recognition
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Journal of Selected Topics in Signal Processing cover
IEEE Journal of Selected Topics in Signal Processing
IF:
13.7
Papers:
1.9K
Citations:
1.1W

Organization

N
National Technical University of Athens
Scholars:
9.7K
Papers: 9.5K
Citations: 8.2K
Cited Papers

Cited Papers

Baculovirus Infection Triggers a Shift from Amino Acid Starvation-Induced Autophagy to Apoptosis
err2012-05-21
err0
errOAAI
errWei Wei; Zhongchao Gai; Hui Ai; Wenxian Wu; Yongbo Yang; Jianxin Peng; Huazhu Hong; Yi Li; Kaiyu Liu
errShare
errSave
Microstructural Characteristics of Electron Beam Processed Al-2Sc
err2010-06-30
err0
PREAI
errDacian Tomus; Ma Qian; Peng Yu; Craig A. Brice; Colleen J. Bettles; Barry C. Muddle
errShare
errSave
An analysis of environment, microphone and data simulation mismatches in robust speech recognition
err2017-11-01
err216
errOAAI
errVincent, Emmanuel; Watanabe, Shinji; Nugraha, Aditya Arie; Barker, Jon; Marxer, Ricard
errShare
errSave
Robust AM-FM features for speech recognition
err2005-09-01
err82
PREAI
errDimitriadis, D; Maragos, P; Potamianos, A
errShare
errSave
Prevention of Overweight and Obesity
err2004-01-01
err0
PREAI
errM.J. M�ller; S. Danielzik; C. Spethmann
errShare
errSave
researcher View more