arrow
返回

Fast Distributed Gradient Methods

delete2014-05-01
delete463
delete
OA
AI
D
Dušan Jakovetić *
J
João Xavier
J
José M. F. Moura
DOI:10.1109/TAC.2014.2298712delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We study distributed optimization problems when N nodes minimize the sum of their individual costs subject to a common vector variable. The costs are convex, have Lipschitz continuous gradient (with constant L), and bounded gradient. We propose two fast distributed gradient algorithms based on the centralized Nesterov gradient algorithm and establish their convergence rates in terms of the per-node communications /C and the per-node gradient evaluations k. Our first method, Distributed Nesterov Gradient, achieves rates O (log K/K) and O (log k/k). Our second method, Distributed Nesterov gradient with Consensus iterations, assumes at all nodes knowledge of L and.t(W) - the second largest singular value of the N x N doubly stochastic weight matrix W. It achieves rates O (1/k(2-epsilon)) and O (1/k(2)) (epsilon > 0 arbitrarily small). Further, we give for both methods explicit dependence of the convergence constants on N and W. Simulation examples illustrate our findings.
Keyword:
Consensus
convergence rate
distributed optimization
Nesterov gradient

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

U
universidade de lisboa
学者数:
3.4W
论文数: 3.1W
被引数: 29
C
Carnegie Mellon University
学者数:
1.4W
论文数: 1.4W
被引数: 2.7W
U
universidade de coimbra
学者数:
1.9W
论文数: 1.6W
被引数: 16
学者 查看更多机构
引用论文

引用论文

New hollandite oxides: TiO2(H) and K0.06TiO2
err1989-07-01
err0
PREAI
errM. Latroche; L. Brohan; R. Marchand; M. Tournoux
err分享
err收藏
Fast Distributed Gradient Methods快速分布梯度法
err2014-05-01
err463
errOAAI
errJakovetic, Dusan; Xavier, Joao; Moura, Jose M. F.
err分享
err收藏
Toward Self-Healing Hydrogels Using One-Pot Thiol–Ene Click and Borax-Diol Chemistry
err2015-06-10
err0
PREAI
errLirong He; Daniel Szopinski; Yang Wu; Gerrit A. Luinstra; Patrick Theato
err分享
err收藏
On decentralized negotiation of optimal consensus
err2008-04-01
err69
errOAAI
errJohansson, Bjorn; Speranzon, Alberto; Johansson, Mikael; Johansson, Karl Henrik
err分享
err收藏
err分享
err收藏
学者 查看更多内容