arrow
返回

Improving a statistical language model through non-linear prediction

delete2009-03-01
delete12
PRE
AI
A
Andriy Mnih *
Y
Yuecheng Zhang
G
Geoffrey E. Hinton
DOI:10.1016/j.neucom.2008.12.025delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We show how to improve a state-of-the-art neural network language model that converts the previous context words into feature vectors and combines these feature vectors linearly to predict the feature vector of the next word. Significant improvements in predictive accuracy are achieved by using a non-linear subnetwork to modulate the effects of the context words or to produce a non-linear correction term when predicting the feature vector. A log-bilinear language model that incorporates both of these improvements achieves a 26% reduction in perplexity over the best n-gram model on a fairly large dataset. (C) 2009 Elsevier B.V. All rights reserved.
Keyword:
Statistical language modelling
Distributed representations
Neural networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
university of toronto
学者数:
14.8W
论文数: 12.0W
被引数: 165
引用论文

引用论文

A neural syntactic language model
err2005-06-02
err44
errOAAI
errEmami, A; Jelinek, F
err分享
err收藏
Spending Less After (Seemingly) Bad News
err
IF0
err2020-04-01
err0
errOAAI
errMark Garmaise; Yaron Levi; Hanno Lustig
err分享
err收藏
err分享
err收藏
Class systems and the enforcement of social norms
err1998-10-01
err0
errOAAI
errHarold L. Cole; George J. Mailath; Andrew Postlewaite
err分享
err收藏
没有更多内容