arrow
Return

Innovation Compression for Communication-Efficient Distributed Optimization With Linear Convergence

delete2023-11-01
delete9
delete
OA
AI
J
Jiaqi Zhang
游科友 (Keyou You) *
L
Lihua Xie
DOI:10.1109/TAC.2023.3241771delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks. This article proposes a communication-efficient linearly convergent distributed (COLD) algorithm to solve strongly convex optimization problems. By compressing innovation vectors, which are the differences between decision vectors and their estimates, COLD achieves linear convergence for a class of delta-contracted compressors, and we explicitly quantify how the compression affects the convergence rate. Interestingly, our results strictly improve existing results for the quantized consensus problem. Numerical experiments demonstrate the advantages of COLD under different compressors.
Keywords:
Compression
distributed optimization
innovation
linear convergence.

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W