arrow
Return

A Compressed Gradient Tracking Method for Decentralized Optimization With Linear Convergence

delete2022-10-01
delete25
delete
OA
AI
Y
Yiwei Liao
Z
Z. J. Li
K
Kun Huang
S
Shi Pu *
DOI:10.1109/TAC.2022.3180695delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multiagent network using only local computation and peer-to-peer communication. In this article, we propose a novel compressed gradient tracking algorithm (C-GT) that combines gradient tracking technique with communication compression. In particular, C-GT is compatible with a general class of compression operators that unifies both unbiased and biased compressors. We show that C-GT inherits the advantages of gradient tracking-based algorithms and achieves linear convergence rate for strongly convex and smooth objective functions. Numerical examples complement the theoretical findings and demonstrate the efficiency and flexibility of the proposed algorithm.
Keywords:
Linear programming
Convergence
Compressors
Quantization (signal)
Cost function
Robots
Radio frequency
Communication compression
decentralized optimization
gradient tracking
linear convergence

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
T
The Chinese University of Hong Kong, Shenzhen
Scholars:
4.3K
Papers: 4.0K
Citations: 7
S
Shenzhen Research Institute of Big Data
Scholars:
256
Papers: 352
Citations: 357
researcher View more organizations
Cited Papers

Cited Papers

Model experiments pertaining to the mechanism of action of vitamin B12-dependent α-methyleneglutarate mutase
err1989-01-01
err0
PREAI
errSusan Ashwell; Alwyn G. Davies; Bernard T. Golding; Robyn Hay-Motherwell; Samson Mwesigye-Kibende
errShare
errSave
Long-term members’ use of fitness centers: a qualitative study
err2019-02-21
err0
errOAAI
errLiv Riseth; Torunn Hatlen Nøst; Tom I. L. Nilsen; Aslak Steinsbekk
errShare
errSave
Die stereoisomeren 1,4‐Dimercaptobutadiene
err2010-09-02
err0
PREAI
errW. Schroth; F. Billig; H. Langguth
errShare
errSave
errShare
errSave
researcher View more