返回
Weighted contrastive divergence
DOI:10.1016/j.neunet.2018.09.013.png)
摘要
En 中文
Learning algorithms for energy based Boltzmann architectures that rely on gradient descent are in general computationally prohibitive, typically due to the exponential number of terms involved in computing the partition function. In this way one has to resort to approximation schemes for the evaluation of the gradient. This is the case of Restricted Boltzmann Machines (RBM) and its learning algorithm Contrastive Divergence (CD). It is well-known that CD has a number of shortcomings, and its approximation to the gradient has several drawbacks. Overcoming these defects has been the basis of much research and new algorithms have been devised, such as persistent CD. In this manuscript we propose a new algorithm that we call Weighted CD (WCD), built from small modifications of the negative phase in standard CD. However small these modifications may be, experimental work reported in this paper suggests that WCD provides a significant improvement over standard CD and persistent CD at a small additional computational cost. (c) 2018 Elsevier Ltd. All rights reserved.
Keyword:
Neural networks
Restricted Boltzmann machine
Contrastive divergence
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
8.3K
被引数:
3.0W
机构
引用论文
Improved Particle Size Control for the Dispersion Polymerization of Methyl methacrylate in Supercritical Carbon Dioxide超临界二氧化碳中甲基丙烯酸甲酯分散聚合的改进粒度控制
Crystal chemistry and metal-hydrogen bonding in anisotropic and interstitial hydrides of intermetallics of rare earth (R) and transition metals (T), RT3 and R2T7稀土 (R) 和过渡金属 (T) 的金属间化合物的各向异性和间隙氢化物中的晶体化学和金属氢键,RT3 和R2T7

