arrow
Return

The Sequence Memoizer

delete2011-02-01
delete36
PRE
AI
F
Frank Wood *
J
Jan Gasthaus
C
Cédric Archambeau
L
Lancelot F. James
Y
Yee Whye Teh
DOI:10.1145/1897816.1897842delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Probabilistic models of sequences play a central role in most machine translation, automated speech recognition, lossless compression, spell-checking, and gene identification applications to name but a few. Unfortunately, real-world sequence data often exhibit long range dependencies which can only be captured by computationally challenging, complex models. Sequence data arising from natural processes also often exhibits power-law properties, yet common sequence models do not capture such properties. The sequence memoizer is a new hierarchical Bayesian model for discrete sequence data that captures long range dependencies and power-law characteristics, while remaining computationally attractive. Its utility as a language model and general purpose lossless compressor is demonstrated.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Communications of the ACM cover
Communications of the ACM
IF:
12.2
Papers:
1.2W
Citations:
3.7W

Organization

C
Columbia University
Scholars:
7.1W
Papers: 6.4W
Citations: 263
U
University College London
Scholars:
7.9W
Papers: 6.2W
Citations: 15.7W
X
xerox
Scholars:
226
Papers: 183
Citations: 0
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
researcher View more organizations