.png){kind=icon}
返回
Linear Convergence of Asynchronous Gradient Push Algorithm for Distributed Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TSMC.2024.3516936.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article focuses on multiagent distributed asynchronous optimization over directed networks where each agent can only access its individual local function, and the aggregate aim is to minimize the cumulative sum of all local functions. Considering the asynchrony among the agents, we develop an algorithm in which agents compute and communicate individually, without any form of synchronized coordination. Agents perform their local updates by local communication with their immediate neighbors, and this may involve the use of stale information. Since asynchrony naturally leads to latency or packet loss, an asynchronous robust gradient tracking mechanism is developed to guarantee estimating the average of agents' gradients precisely. Moreover, it employs uncoordinated step-sizes which are more flexible and general than constant or decaying step-size. When the global objective is strongly convex and the local objectives have Lipschitz-continuous gradients, we prove that each agent executing the asynchronous algorithm linearly converges to the consensus optimal point at an O(lambda(k)) rate, where lambda is an element of (0, 1) is convergence factor and k represents the iteration number, with a step satisfying a tight explicit upper bound. Numerical experiments demonstrate that our algorithm has better advantages over the state-of-the-art asynchronous algorithms.
Keyword:
Convergence
Optimization
Protocols
System recovery
Linear programming
Electronic mail
Delays
Vectors
Synchronization
Fasteners
Asynchronous algorithm
delay
distributed optimization
linear convergence
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
暂无机构信息
引用论文
.png){kind=icon}
Distributed Adaptive Event-Triggered Algorithms for Nonsmooth Resource Allocation Optimization Over Switching Topologies分布式自适应事件触发算法，用于交换拓扑上的非平滑资源分配优化
PREAI
分享收藏Accelerated Distributed Nesterov Optimization Subject to Complex Constraints and Its Applications
PREAI
分享收藏
查看更多内容