arrow
返回

Weighted contrastive divergence

delete2019-06-01
delete14
delete
OA
AI
E
Enrique Romero
F
F. Mazzanti *
J
Jordi Delgado
D
David Buchaca
DOI:10.1016/j.neunet.2018.09.013delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Learning algorithms for energy based Boltzmann architectures that rely on gradient descent are in general computationally prohibitive, typically due to the exponential number of terms involved in computing the partition function. In this way one has to resort to approximation schemes for the evaluation of the gradient. This is the case of Restricted Boltzmann Machines (RBM) and its learning algorithm Contrastive Divergence (CD). It is well-known that CD has a number of shortcomings, and its approximation to the gradient has several drawbacks. Overcoming these defects has been the basis of much research and new algorithms have been devised, such as persistent CD. In this manuscript we propose a new algorithm that we call Weighted CD (WCD), built from small modifications of the negative phase in standard CD. However small these modifications may be, experimental work reported in this paper suggests that WCD provides a significant improvement over standard CD and persistent CD at a small additional computational cost. (c) 2018 Elsevier Ltd. All rights reserved.
Keyword:
Neural networks
Restricted Boltzmann machine
Contrastive divergence
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.3K
被引数:
3.0W

机构

U
universitat politecnica de catalunya
学者数:
404
论文数: 179
被引数: 0
引用论文

引用论文

Trade Structure, FTAs, and Economic Growth
err2010-07-16
err0
PREAI
errChan‐Hyun Sohn; Hongshik Lee
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容