返回
Multi-channel spectrograms for speech processing applications using deep learning methods
DOI:10.1007/s10044-020-00921-5.png)
摘要
En 中文
Time-frequency representations of the speech signals provide dynamic information about how the frequency component changes with time. In order to process this information, deep learning models with convolution layers can be used to obtain feature maps. In many speech processing applications, the time-frequency representations are obtained by applying the short-time Fourier transform and using single-channel input tensors to feed the models. However, this may limit the potential of convolutional networks to learn different representations of the audio signal. In this paper, we propose a methodology to combine three different time-frequency representations of the signals by computing continuous wavelet transform, Mel-spectrograms, and Gammatone spectrograms and combining then into 3D-channel spectrograms to analyze speech in two different applications: (1) automatic detection of speech deficits in cochlear implant users and (2) phoneme class recognition to extract phone-attribute features. For this, two different deep learning-based models are considered: convolutional neural networks and recurrent neural networks with convolution layers.
Keyword:
Speech processing
Multi-channel spectrograms
Cochlear implants
Phoneme recognition
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2
论文数:
1.9K
被引数:
1.9K
机构
引用论文
Voice Pathology Detection Using Deep Learning on Mobile Healthcare Framework基于移动医疗框架的深度学习语音病理检测
IEEE ACCESS
IF3.6
Dispersion Corrections Improve the Accuracy of Both Noncovalent and Covalent Interactions Energies Predicted by a Density-Functional Theory Approximation色散校正提高了通过密度泛函理论近似预测的非共价和共价相互作用能量的准确性
Molecular Profiling Of Blastic Plasmacytoid Dendritic CELL Neoplasm Reveals A Unique Pattern and Suggests Selective Sensitivity To NF-KB Pathway Inhibition
Blood
IF0
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用
PROCEEDINGS OF THE IEEE
IF25.9

