.png){kind=icon}
.png){kind=icon}
Return
Linear Convergence of Asynchronous Gradient Push Algorithm for Distributed Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TSMC.2024.3516936.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This article focuses on multiagent distributed asynchronous optimization over directed networks where each agent can only access its individual local function, and the aggregate aim is to minimize the cumulative sum of all local functions. Considering the asynchrony among the agents, we develop an algorithm in which agents compute and communicate individually, without any form of synchronized coordination. Agents perform their local updates by local communication with their immediate neighbors, and this may involve the use of stale information. Since asynchrony naturally leads to latency or packet loss, an asynchronous robust gradient tracking mechanism is developed to guarantee estimating the average of agents' gradients precisely. Moreover, it employs uncoordinated step-sizes which are more flexible and general than constant or decaying step-size. When the global objective is strongly convex and the local objectives have Lipschitz-continuous gradients, we prove that each agent executing the asynchronous algorithm linearly converges to the consensus optimal point at an O(lambda(k)) rate, where lambda is an element of (0, 1) is convergence factor and k represents the iteration number, with a step satisfying a tight explicit upper bound. Numerical experiments demonstrate that our algorithm has better advantages over the state-of-the-art asynchronous algorithms.
Keywords:
Convergence
Optimization
Protocols
System recovery
Linear programming
Electronic mail
Delays
Vectors
Synchronization
Fasteners
Asynchronous algorithm
delay
distributed optimization
linear convergence
Journal
IF:
10.5
Papers:
1.1W
Citations:
5.0W
Organization
No organization information available