arrow
返回

Accelerated Distributed Nesterov Gradient Descent

delete2020-06-01
delete141
delete
OA
AI
G
Guannan Qu *
N
Na Li
DOI:10.1109/TAC.2019.2937496delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper considers the distributed optimization problem over a network, where the objective is to optimize a global function formed by a sum of local functions, using only local computation and communication. We develop an accelerated distributed Nesterov gradient descent method. When the objective function is convex and L-smooth, we show that it achieves a O(1/t(1.4-epsilon)) convergence rate for all epsilon is an element of (0, 1.4). We also show the convergence rate can be improved to O(1/t(2)) if the objective function is a composition of a linear map and a strongly convex and smooth function. When the objective function is mu-strongly convex and L-smooth, we show that it achieves a linear convergence rate of O([1 - C(mu/L)(5/7)](t)), where L/mu is the condition number of the objective, and C > 0 is some constant that does not depend on L/mu.
Keyword:
Convergence
Acceleration
Convex functions
Radio frequency
Linear programming
Gradient methods
Distributed algorithms
multiagent systems
optimization methods
distributed optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
引用论文

引用论文

Thermal desorption of gases
err1962-07-01
err0
PREAI
errP.A. Redhead
err分享
err收藏
Synthesis and biological evaluation of analogs of the marine toxin polycavernoside A
err1999-07-01
err0
PREAI
errLouis Barriault; Serge L. Boulet; Kenshu Fujiwara; Akio Murai; Leo A. Paquette; Mari Yotsu-Yamashita
err分享
err收藏
Muonium reaction kinetics with the hydrogen halide gases
err1992-11-01
err0
PREAI
errAlicia C. Gonzalez; Alexandra Tempelmann; Donald J. Arseneau; Donald G. Fleming; Masayoshi Senba; James R. Kempton; James J. Pan
err分享
err收藏
Impaired B Cell Development and Proliferation in Absence of Phosphoinositide 3-Kinase p85α
err1999-01-15
err0
PREAI
errDavid A. Fruman; Scott B. Snapper; Claudine M. Yballe; Laurie Davidson; Jonathan Y. Yu; Frederick W. Alt; Lewis C. Cantley
err分享
err收藏
学者 查看更多内容