arrow
返回

Multi-channel spectrograms for speech processing applications using deep learning methods

delete2020-09-24
delete60
delete
OA
AI
T
Tomás Arias‐Vergara *
P
Philipp Klumpp
J
Juan Camilo Vásquez-Correa
N
Noeth, E.
J
Juan Rafael Orozco‐Arroyave
M
Martin J. Schuster
DOI:10.1007/s10044-020-00921-5delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Time-frequency representations of the speech signals provide dynamic information about how the frequency component changes with time. In order to process this information, deep learning models with convolution layers can be used to obtain feature maps. In many speech processing applications, the time-frequency representations are obtained by applying the short-time Fourier transform and using single-channel input tensors to feed the models. However, this may limit the potential of convolutional networks to learn different representations of the audio signal. In this paper, we propose a methodology to combine three different time-frequency representations of the signals by computing continuous wavelet transform, Mel-spectrograms, and Gammatone spectrograms and combining then into 3D-channel spectrograms to analyze speech in two different applications: (1) automatic detection of speech deficits in cochlear implant users and (2) phoneme class recognition to extract phone-attribute features. For this, two different deep learning-based models are considered: convolutional neural networks and recurrent neural networks with convolution layers.
Keyword:
Speech processing
Multi-channel spectrograms
Cochlear implants
Phoneme recognition
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Analysis and Applications 封面图
Pattern Analysis and Applications
IF:
2
论文数:
1.9K
被引数:
1.9K

机构

U
University of Erlangen Nuremberg
学者数:
3.2W
论文数: 2.6W
被引数: 29
U
Universidad de Antioquia
学者数:
6.2K
论文数: 4.5K
被引数: 7
U
University of Munich
学者数:
5.7W
论文数: 4.2W
被引数: 68
学者 查看更多机构
引用论文

引用论文

Molecular Profiling Of Blastic Plasmacytoid Dendritic CELL Neoplasm Reveals A Unique Pattern and Suggests Selective Sensitivity To NF-KB Pathway Inhibition
err2013-11-15
err0
PREAI
errPier Paolo Piccaluga; Maria Rosaria Sapienza; Fuligni Fabio; Agostinelli Claudio; Tripodo Claudio; Righi Simona; Maria Antonella Laginestra; Pileri Alessandro; Rossi Maura; Francesca Ricci; Anna Gazzola; Claudia Mannu; Francesca Ulbar; Mario Arpinati; Marco Paulli; Davide Gibellini; Livio Pagano; Nicola Pimpinelli; Lorenzo Cerroni; Carlo M. Croce; Fabio Facchetti; Stefano A Pileri
err分享
err收藏
CD133, OCT4, and NANOG in ulcerative colitis-associated colorectal cancer
err2011-09-06
err0
errOAAI
errHIROMI YASUDA; KOJI TANAKA; YOSHIKI OKITA; TOSHIMITSU ARAKI; SUSUMU SAIGUSA; YUJI TOIYAMA; TAKESHI YOKOE; SHIGEYUKI YOSHIYAMA; AYA KAWAMOTO; YASUHIRO INOUE; CHIKAO MIKI; MASATO KUSUNOKI
err分享
err收藏
Deep Learning for Audio Signal Processing
err2019-05-01
err423
errOAAI
errPurwins, Hendrik; Li, Bo; Virtanen, Tuomas; Schlueter, Jan; Chang, Shuo-Yiin; Sainath, Tara
err分享
err收藏
学者 查看更多内容