arrow
Return

A Transformer-Based End-to-End Automatic Speech Recognition Algorithm

delete2023-01-01
delete3
PRE
AI
F
Fang Dong
Y
Yiyang Qian
T
Tianlei Wang
P
Peng Liu
J
Jiuwen Cao *
DOI:10.1109/LSP.2023.3328238delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
End-to-End (E2E) automatic speech recognition (ASR) becomes popular recent years and has been widely used in many applications. However, current ASR algorithms are usually less effective when applied in specific applications with terminologies such as medical and economic fields. To address this issue, we propose a powerful Transformer based ASR decoding method for beam searching, called soft beam pruning algorithm (SBPA). SBPA can dynamically adjust the width of beam search. Meanwhile, a prefix module (PM) is added to access the contextual information and avoid removing professional words in the beam search. Combining SBPA and PM, the proposed ASR can achieve promising recognition performance on professional terminologies. To verify the effectiveness, experiments are conducted on real-world conversation data with medical terminology. It is shown that the proposed ASR achieved significant performance on both professional and regular words.
Keywords:
Automatic speech recognition
soft beam pruning
prefix module
transformer
professional terminology

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.6K
Citations: 7.5K
H
Hangzhou City University
Scholars:
2.2K
Papers: 2.0K
Citations: 1.0K