arrow
返回

Distributed optimization for deep learning with gossip exchange

delete2019-02-01
delete37
delete
OA
AI
D
David Picard
N
Nicolas Thome
M
Matthieu Cord
DOI:10.1016/j.neucom.2018.11.002delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual gradient descents on a local variable. We propose a new way of sharing information between different threads based on gossip algorithms that show good consensus convergence properties. Our method called GoSGD has the advantage to be fully asynchronous and decentralized. (C) 2018 Published by Elsevier B.V.
Keyword:
Optimization
Distributed gradient descent
Gossip
Deep
Learning
Neural networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

C
centre national de la recherche scientifique (cnrs)
学者数:
24.5W
论文数: 18.2W
被引数: 279
引用论文

引用论文

Brain Morphological Changes and Early Marijuana Use
err2010-02-02
err0
PREAI
errWilliam Wilson; Roy Mathew; Timothy Turkington; Thomas Hawk; R. Edward Coleman; James Provenzale
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Markov Chains
err2009-01-01
err0
PREAI
errRichard Serfozo
err分享
err收藏
Asynchronous gossip principal components analysis
err2015-12-01
err4
errOAAI
errFellus, Jerome; Picard, David; Gosselin, Philippe-Henri
err分享
err收藏
没有更多内容