.png){kind=icon}
返回
Joint Speech-Text Embeddings for Multitask Speech Processing
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3473743.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Devices that use speech as the communication medium between human and computer have been emerging for the past few years. The technologies behind this interface are called Automatic Speech Recognition (ASR) and Text-to-Speech (TTS). The two are distinct fields in speech signal processing that have independently made great strides in recent years. This paper proposes an architecture that takes advantage of the two modalities present in ASR and TTS, speech and text, while simultaneously training three tasks, adding speaker recognition to the underlying ASR and TTS tasks. This architecture not only reduces the memory footprint required to run all tasks, but also has performance comparable to single-task models. The dataset used to train and evaluate the model is the CSTR VCTK Corpus. Results show a 97.64% accuracy in the speaker recognition task, word and character error rates of 18.18% and 7.95% for the ASR task, a mel cepstral distortion of 4.31 and two predicted MOS of 2.98 and 3.28 for the TTS task. While voice conversion is not part of the training tasks, the architecture is capable of doing this and was evaluated to have 5.22, 2.98, and 2.73 for mel cepstral distortion and predicted MOS, respectively.
Keyword:
Speaker recognition
Spectrogram
Decoding
Training
Feature extraction
Analytical models
Speech coding
Propagation losses
Automatic speech recognition
Speech to text
Text to speech
Speech processing
joint speech-text
text-to-speech
speaker recognition
speech processing
voice conversion
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
FRI0388 ARE WE OVERLOOKING OSTEOARTHRITIS? – A COMPARATIVE STUDY OF PAIN, FUNCTION AND QUALIFY OF LIFE IN PATIENTS WITH HAND OSTEOARTHRITIS AND RHEUMATOID ARTHRITISFRI0388 我们是否忽视了骨关节炎？——手骨关节炎与类风湿关节炎患者疼痛、功能和生活质量比较研究
PREAI
分享收藏HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units休伯特: 通过隐藏单元的掩蔽预测进行自我监督的语音表示学习OAAI
OAAI分享收藏Elicitation Improves the Production of Bioactive Compounds and Antioxidant Activity in Cell Suspension Culture of Withania coagulans (Stocks) Dunal外源诱导能够提高W. coagulans (Stocks) Dunal细胞悬浮培养中生物活性化合物的产量和抗氧化活性。OAAI
OAAI分享收藏
查看更多内容