arrow
Return

Achieving Linear Convergence in Distributed Asynchronous Multiagent Optimization

delete2020-12-01
delete45
delete
OA
AI
Y
Ye Tian
Y
Ying Sun
G
Gesualdo Scutari *
DOI:10.1109/TAC.2020.2977940delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This article studies multiagent (convex and nonconvex) optimization over static digraphs. We propose a general distributed asynchronous algorithmic framework whereby 1) agents can update their local variables as well as communicate with their neighbors at any time, without any form of coordination; and 2) they can perform their local computations using (possibly) delayed, out-of-sync information from the other agents. Delays need not be known to the agent or obey any specific profile, and can also be time-varying (but bounded). The algorithm builds on a tracking mechanism that is robust against asynchrony (in the above sense), whose goal is to estimate locally the average of agents' gradients. When applied to strongly convex functions, we prove that it converges at an R-linear (geometric) rate as long as the step-size is sufficiently small. A sublinear convergence rate is proved, when nonconvex problems and/or diminishing, uncoordinated step-sizes are considered. To the best of our knowledge, this is the first distributed algorithm with provable geometric convergence rate in such a general asynchronous setting. Preliminary numerical results demonstrate the efficacy of the proposed algorithm and validate our theoretical findings.
Keywords:
Delays
Convergence
Optimization
Convex functions
Distributed algorithms
Robustness
Indexes
Asynchrony
delay
directed graphs
distributed optimization
linear convergence
nonconvex optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

Purdue University System cover
Purdue University System
Scholars:
4.0W
Papers: 3.6W
Citations: 66
Cited Papers

Cited Papers

errShare
errSave
Cooperative Distributed Optimization in Multiagent Networks With Delays
err2015-02-01
err131
PREAI
errWang, Huiwei; Liao, Xiaofeng; Huang, Tingwen; Li, Chaojie
errShare
errSave
Chiral Synthesis of Heterosubstituted Nucleoside Analogs from Noncarbohydrate Precursors
err2007-07-01
err0
PREAI
errFabio Casu; Maria Assunta Chiacchio; Roberto Romeo; Giuseppe Gumina
errShare
errSave
Robust Distributed Average Consensus via Exchange of Running Sums
err2016-06-01
err70
PREAI
errHadjicostis, Christoforos N.; Vaidya, Nitin H.; Dominguez-Garcia, Alejandro D.
errShare
errSave
Successful Therapy of Chronic Renal Allograft Failure by Enhanced Immunosuppression
err1998-06-01
err0
PREAI
errV Kliem; T Tiroke; G Ehlerding; O Eberhard; M Behrend; U Frei; K.M Koch; R Pichlmayr; R Brunkhorst
errShare
errSave
An Efficient and Rapid Synthesis of 2-amino-4-arylthiazoles Employing Microwave Irradiation in Water
err2011-01-01
err0
errOAAI
errKishor S. Jain; Jitender B. Bariwal; Muthu K. Kathiravan; Vikas K. Raskar; Gajanan S. Wankhede; Nitin A. Londhe; Satish N. Dighe
errShare
errSave
researcher View more