arrow
Return

Representation and processing of structures with binary sparse distributed codes

delete2001-01-01
delete65
PRE
AI
D
Dmitri A. Rachkovskij
DOI:10.1109/69.917565delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The schemes for compositional distributed representations include those allowing on-the-fly construction of fixed dimensionality codevectors to encode structures of various complexity. Similarity of such codevectors takes into account both structural and semantic similarity of represented structures, in this paper, we provide a comparative description of sparse binary distributed representation developed in the framework of the associative-projective neural network architecture and the more well-known holographic reduced representations of Plate and binary spatter codes of Kanerva. The key procedure in associative-projective neural networks is context-dependent thinning which binds codevectors and maintains their sparseness. The codevectors are stored in structured memory array which can be realized as distributed auto-associative memory. Examples of distributed representation of structured data are given. Fast estimation of the similarity of analogical episodes by the overlap of their codevectors is used in the modeling of analogical reasoning both for retrieval of analogs from memory and for analogical mapping.
Keywords:
sparse coding
binary coding
binding
representation of structure
hierarchical representation
nested representation
long-term memory
analogy
compositional distributed representations
connectionist symbol processing
analogical retrieval
analogical mapping

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

No organization information available
Cited Papers

Cited Papers

17O solid-state NMR spectroscopy of A2B2O7oxides: quantitative isotopic enrichment and spectral acquisition?
err2018-01-01
err0
errOAAI
errArantxa Fernandes; Robert F. Moran; Scott Sneddon; Daniel M. Dawson; David McKay; Giulia P. M. Bignami; Frédéric Blanc; Karl R. Whittle; Sharon E. Ashbrook
errShare
errSave
errShare
errSave
err
IF0
err
err0
errOAAI
err
errShare
errSave
Social constraints limit dispersal and settlement decisions in a group-living bird species
err2007-12-13
err0
errOAAI
errMichael Griesser; Magdalena Nystrand; Sönke Eggers; Jan Ekman
errShare
errSave
researcher View more