arrow
返回

Modelling neural probabilistic computation using vector symbolic architectures

delete2023-12-16
delete1
PRE
AI
P
P. Michael Furlong *
C
Chris Eliasmith
DOI:10.1007/s11571-023-10031-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributed vector representations are a key bridging point between connectionist and symbolic representations in cognition. It is unclear how uncertainty should be modelled in systems using such representations. In this paper we discuss how bundles of symbols in certain Vector Symbolic Architectures (VSAs) can be understood as defining an object that has a relationship to a probability distribution, and how statements in VSAs can be understood as being analogous to probabilistic statements. The aim of this paper is to show how (spiking) neural implementations of VSAs can be used to implement probabilistic operations that are useful in building cognitive models. We show how similarity operators between continuous values represented as Spatial Semantic Pointers (SSPs), an example of a technique known as fractional binding, induces a quasi-kernel function that can be used in density estimation. Further, we sketch novel designs for networks that compute entropy and mutual information of VSA-represented distributions and demonstrate their performance when implemented as networks of spiking neurons. We also discuss the relationship between our technique and quantum probability, another technique proposed for modelling uncertainty in cognition. While we restrict ourselves to operators proposed for Holographic Reduced Representations, and for representing real-valued data. We suggest that the methods presented in this paper should translate to any VSA where the dot product between fractionally bound symbols induces a valid kernel.
Keyword:
Probability
Bayesian modelling
Vector symbolic architecture
Fractional binding
Spatial semantic pointers

期刊

Cognitive Neurodynamics 封面图
Cognitive Neurodynamics
IF:
3.9
论文数:
1.5K
被引数:
2.8K

机构

U
University of Waterloo
学者数:
2.2W
论文数: 2.3W
被引数: 3.3W
引用论文

引用论文

Vector Symbolic Architectures as a Computing Framework for Emerging Hardware
err2022-10-01
err29
errOAAI
errKleyko, Denis; Davies, Mike; Frady, E. Paxon; Kanerva, Pentti; Kent, Spencer J.; Olshausen, Bruno A.; Osipov, Evgeny; Rabaey, Jan M.; Rachkovskij, Dmitri A.; Rahimi, Abbas; Sommer, Friedrich T.
err分享
err收藏
Low Loss Plastic Terahertz Photonic Band-Gap Fibres
err2008-10-30
err0
PREAI
errGeng You-Fu; Tan Xiao-Ling; Zhong Kai; Wang Peng; Yao Jian-Quan
err分享
err收藏
学者 查看更多内容