返回
Distributed optimization for deep learning with gossip exchange
DOI:10.1016/j.neucom.2018.11.002.png)
摘要
En 中文
We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual gradient descents on a local variable. We propose a new way of sharing information between different threads based on gossip algorithms that show good consensus convergence properties. Our method called GoSGD has the advantage to be fully asynchronous and decentralized. (C) 2018 Published by Elsevier B.V.
Keyword:
Optimization
Distributed gradient descent
Gossip
Deep
Learning
Neural networks
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用
PROCEEDINGS OF THE IEEE
IF25.9
Effects of heated seat and foot heater on thermal comfort and heater energy consumption in vehicle加热座椅和脚加热器对车内热舒适性和加热器能耗的影响
Ergonomics
IF0
没有更多内容

