.png){kind=icon}
返回
Automatic Disfluency Detection From Untranscribed Speech
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2024.3485465.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Speech disfluencies, such as filled pauses or repetitions, are disruptions in the typical flow of speech. All speakers experience disfluencies at times, and the rate at which we produce disfluencies may be increased by certain speaker or environmental characteristics. Modeling disfluencies has been shown to be useful for a range of downstream tasks, and as a result, disfluency detection has many potential applications. In this work, we investigate language, acoustic, and multimodal methods for frame-level automatic disfluency detection and categorization. Each of these methods relies on audio as an input. First, we evaluate several automatic speech recognition (ASR) systems in terms of their ability to transcribe disfluencies, measured using disfluency error rates. We then use these ASR transcripts as input to a language-based disfluency detection model. We find that disfluency detection performance is largely limited by the quality of transcripts and alignments. We find that an acoustic-based approach that does not require transcription as an intermediate step outperforms the ASR language approach. Finally, we present multimodal architectures which we find improve disfluency detection performance over the unimodal approaches. Ultimately, this work introduces novel approaches for automatic frame-level disfluency and categorization. In the long term, this will help researchers incorporate automatic disfluency detection into a range of applications.
Keyword:
Acoustics
Feature extraction
Location awareness
Speech processing
Bidirectional control
Planning
Encoding
Transformers
Neural networks
Long short term memory
Automatic disfluency detection
multimodal disfluency detection
frame-level disfluency detection
disfluency categorization
automatic speech recognition
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
Matrix Effects in the Detection of Pb and Ba in Soils Using Laser-Induced Breakdown Spectroscopy使用激光诱导击穿光谱检测土壤中Pb和Ba的基质效应
PREAI
分享收藏HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units休伯特: 通过隐藏单元的掩蔽预测进行自我监督的语音表示学习
OAAI
OAAI分享收藏The montreal cognitive assessment, MoCA:: A brief screening tool for mild cognitive impairment蒙特利尔认知评估，MoCA:: 轻度认知障碍的简短筛查工具
PREAI
分享收藏Glycinebetaine Stabilizes Photosystem 1 and Photosystem 2 Electron Transport in Spinach Thylakoid Membranes Against Heat Inactivation甜菜碱稳定菠菜类囊体膜中光合系统1和光合系统2的电子传递，抵抗热失活。
OAAI
OAAI分享收藏Selection of an efficient vesicular-arbuscular mycorrhizal fungus for chilli (Capsicum annuum L.)选择一种高效的内生菌根真菌用于辣椒（Capsicum annuum L.）
PREAI
分享收藏The major DNA polymerase in cultured plant cells: Partial purification and correlation with cell multiplication培养植物细胞中的主要DNA聚合酶：部分纯化及其与细胞增殖的相关性.png)
Planta
PlantaIF0
PREAI
分享收藏
查看更多内容