arrow
Return

Continuous space language models

delete2007-07-01
delete303
PRE
AI
S
Schwenk, Holger *
DOI:10.1016/j.csl.2006.09.003delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper describes the use of a neural network language model for large vocabulary continuous speech recognition. The underlying idea of this approach is to attack the data sparseness problem by performing the language model probability estimation in a continuous space. Highly efficient learning algorithms are described that enable the use of training corpora of several hundred million words. It is also shown that this approach can be incorporated into a large vocabulary continuous speech recognizer using a lattice rescoring framework at a very low additional processing time. The neural network language model was thoroughly evaluated in a state-of-the-art large vocabulary continuous speech recognizer for several international benchmark tasks, in particular the NIST evaluations on broadcast news and conversational speech recognition. The new approach is compared to four-gram back-off language models trained with modified Kneser-Ney smoothing which has often been reported to be the best known smoothing method. Usually the neural network language model is interpolated with the back-off language model. In that way, consistent word error rate reductions for all considered tasks and languages were achieved, ranging from 0.4% to almost 1% absolute. (c) 2006 Elsevier Ltd. All rights reserved.
Keywords:
MAXIMUM-ENTROPY APPROACH
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Computer Speech and Language
IF:
3.4
Papers:
1.5K
Citations:
2.6K

Organization

No organization information available
Cited Papers

Cited Papers

Parents' estimation of psychomotor development in very low birthweight (VLBW) infants
err1995-06-01
err0
PREAI
errAndrea Heiser; Ingrid Grimmer; Boris Metze; Michael Obladen
errShare
errSave
Side-effects of local hyperthermia: Results of a prospectively randomized clinical study
err2009-07-09
err0
PREAI
errSanjiv Sharma; A. P. S. Sandhu; F. D. Patel; Sushmita Ghoshal; B. D. Gupta; N. S. Yadav
errShare
errSave
Pegylation of Magnetically Oriented Lipid Bilayers
err2000-01-01
err0
PREAI
errValencia King; Margaret Parker; Kathleen P Howard
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Ancient BED-domain-containing immune receptor from wild barley confers widely effective resistance to leaf rust
err
IF0
err2020-01-20
err0
errOAAI
errChunhong Chen; Bethany Clark; Matthew Martin; Oadi Matny; Brian J Steffenson; Jerome D Franckowiak; Martin Mascher; Davinder Singh; Dragan Perovic; Terese Richardson; Sambasivam Periyannan; Evans S Lagudah; Robert F Park; Peter M Dracatos
errShare
errSave
researcher View more