.png){kind=icon}
.png){kind=icon}
Return
Improving a statistical language model through non-linear prediction
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2008.12.025.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We show how to improve a state-of-the-art neural network language model that converts the previous context words into feature vectors and combines these feature vectors linearly to predict the feature vector of the next word. Significant improvements in predictive accuracy are achieved by using a non-linear subnetwork to modulate the effects of the context words or to produce a non-linear correction term when predicting the feature vector. A log-bilinear language model that incorporates both of these improvements achieves a 26% reduction in perplexity over the best n-gram model on a fairly large dataset. (C) 2009 Elsevier B.V. All rights reserved.
Keywords:
Statistical language modelling
Distributed representations
Neural networks
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.