arrow
返回

Large-Scale Deep Belief Nets With MapReduce

delete2014-01-01
delete41
delete
OA
AI
K
Kunlei Zhang
X
Xuewen Chen *
DOI:10.1109/ACCESS.2014.2319813delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Deep belief nets (DBNs) with restricted Boltzmann machines (RBMs) as the building block have recently attracted wide attention due to their great performance in various applications. The learning of a DBN starts with pretraining a series of the RBMs followed by fine-tuning the whole net using backpropagation. Generally, the sequential implementation of both RBMs and backpropagation algorithm takes significant amount of computational time to process massive data sets. The emerging big data learning requires distributed computing for the DBNs. In this paper, we present a distributed learning paradigm for the RBMs and the backpropagation algorithm using MapReduce, a popular parallel programming model. Thus, the DBNs can be trained in a distributed way by stacking a series of distributed RBMs for pretraining and a distributed backpropagation for fine-tuning. Through validation on the benchmark data sets of various practical problems, the experimental results demonstrate that the distributed RBMs and DBNs are amenable to large-scale data with a good performance in terms of accuracy and efficiency.
Keyword:
Big data
deep learning
MapReduce
Hadoop
deep belief net (DBN)
restricted Boltzmann machine (RBM)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

W
wayne state university
学者数:
2.0W
论文数: 1.6W
被引数: 17
引用论文

引用论文

Semantic hashing
err2009-07-01
err939
errOAAI
errSalakhutdinov, Ruslan; Hinton, Geoffrey
err分享
err收藏
Cerenkov Luminescence Tomography of Aminopeptidase N (APN/CD13) Expression in Mice Bearing HT1080 Tumors
err2013-05-01
err0
errOAAI
errZhenhua Hu; Weidong Yang; Xiaowei Ma; Wenhui Ma; Xiaochao Qu; Jimin Liang; Jing Wang; Jie Tian
err分享
err收藏
err分享
err收藏
Friction Models and Friction Compensation摩擦模型与摩擦补偿
err1998-01-01
err0
PREAI
errH. Olsson; K.J. Åström; C. Canudas de Wit; M. Gäfvert; P. Lischinsky
err分享
err收藏
Efficacy and safety of the anti-PD-1 monoclonal antibody MK-3475 in 411 patients (pts) with melanoma (MEL).
err2014-05-20
err0
PREAI
errAntoni Ribas; F. Stephen Hodi; Richard Kefford; Omid Hamid; Adil Daud; Jedd D. Wolchok; Wen-Jen Hwu; Tara C. Gangadhar; Amita Patnaik; Anthony M. Joshua; Peter Hersey; Jeffrey S. Weber; Roxana Stefania Dronca; Hassane M. Zarour; Kevin Gergich; Xiaoyun (Nicole) Li; Robert Iannone; Soonmo Peter Kang; Scot Ebbinghaus; Caroline Robert
err分享
err收藏
学者 查看更多内容