.png){kind=icon}
返回
Communication Compression for Distributed Nonconvex Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2022.3225515.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this article, we consider distributed non-convex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents iteratively communicate with neighbors, we propose three distributed primal-dual algorithms with compressed communication. The first two algorithms are applicable to a general class of compressors with bounded relative compression error and the third algorithm is suitable for two general classes of compressors with bounded absolute compression error. We show that the proposed distributed algorithms with compressed communication have comparable convergence properties as state-of-the-art algorithms with exact communication. Specifically, we show that they can find first-order stationary points with sublinear convergence rate O(1/T) when each local cost function is smooth, where T is the total number of iterations, and find global optima with linear convergence rate under an additional condition that the global cost function satisfies the Polyak-Lojasiewicz condition. Numerical simulations are provided to illustrate the effectiveness of the theoretical results.
Keyword:
Communication compression
distributed optimization
linear convergence
nonconvex optimization
Polyak-Lojasiewicz (P-L) condition
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
.png){kind=icon}
分享收藏分享收藏Linear Convergence of First- and Zeroth-Order Primal-Dual Algorithms for Distributed Nonconvex Optimization分布式非凸优化的一阶和零阶原始对偶算法的线性收敛性
OAAI
OAAI分享收藏Quantized Distributed Gradient Tracking Algorithm With Linear Convergence in Directed Networks有向网络中线性收敛的量化分布式梯度跟踪算法OAAI
OAAI分享收藏分享收藏
查看更多内容