arrow
返回

Quantized Zeroth-Order Gradient Tracking Algorithm for Distributed Nonconvex Optimization Under Polyak-Lojasiewicz Condition

delete2024-10-01
delete1
PRE
AI
L
Lei Xu
X
Xinlei Yi
C
Chao Deng
Y
Yang Shi
T
Tianyou Chai
T
Tao Yang *
DOI:10.1109/TCYB.2024.3384924delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article focuses on distributed nonconvex optimization by exchanging information between agents to minimize the average of local nonconvex cost functions. The communication channel between agents is normally constrained by limited bandwidth, and the gradient information is typically unavailable. To overcome these limitations, we propose a quantized distributed zeroth-order algorithm, which integrates the deterministic gradient estimator, the standard uniform quantizer, and the distributed gradient tracking algorithm. We establish linear convergence to a global optimal point for the proposed algorithm by assuming Polyak-Lojasiewicz condition for the global cost function and smoothness condition for the local cost functions. Moreover, the proposed algorithm maintains linear convergence at low-data rates with a proper selection of algorithm parameters. Numerical simulations validate the theoretical results.
Keyword:
Cost function
Standards
Convergence
Vectors
Quantization (signal)
Distributed algorithms
Deep learning
Gradient tracking algorithm
linear convergence
nonconvex optimization
uniform quantizer
zeroth-order algorithm

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

U
University of Victoria
学者数:
1.0W
论文数: 1.0W
被引数: 1.5W
N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

err分享
err收藏
Communication Compression for Distributed Nonconvex Optimization
err2023-09-01
err11
PREAI
errYi, Xinlei; Zhang, Shengjun; Yang, Tao; Chai, Tianyou; Johansson, Karl Henrik
err分享
err收藏
err分享
err收藏
Substance Use Among High-School Students: Relationships with Temperament, Personality Traits, and Parental Care Perception
err2004-02-25
err0
PREAI
errG. Gerra; L. Angioni; A. Zaimovic; G. Moi; M. Bussandri; S. Bertacca; G. Santoro; S. Gardini; R. Caccavari; M. A. Nicoli
err分享
err收藏
A synthetic fragment of rat transforming growth factor α with receptor binding and antigenic properties
err1985-05-01
err0
PREAI
errJohn J. Nestor; Sherry R. Newman; Barbara DeLustro; George J. Todaro; Alain B. Schreiber
err分享
err收藏
学者 查看更多内容