arrow
返回

Distributed Stochastic Consensus Optimization Using Communication-Censoring Strategy

delete2024-03-01
delete1
delete
OA
AI
李冉冉 (Ranran Li) *
W
Weicheng Xu
余凡 (Fan Yu)
DOI:10.1109/TCNS.2023.3281561delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, a novel communication-efficient distributed stochastic algorithm (CO-DSA) is proposed for solving large-scale consensus optimization problems. As compared to the existing relevant work where only a sublinear convergence rate is obtained for strongly convex and smooth objective functions, the CO-DSA achieves a linear convergence rate even in the presence of an event-triggered communication-censoring strategy. Moreover, by properly setting the threshold function of the event-triggered communication scheme, the CO-DSA maintains the same convergence rate as the algorithm without event-triggered communication. This means the CO-DSA theoretically yields communication efficiency for free. Numerical experiments verify the theoretical findings and also show the excellent communication saving effect of the CO-DSA in large distributed networks.
Keyword:
Communication-censoring strategy
large- scale distributed optimization
linear convergence
stochastic gradient

期刊

IEEE Transactions on Control of Network Systems 封面图
IEEE Transactions on Control of Network Systems
IF:
5
论文数:
1.6K
被引数:
5.8K

机构

N
northeastern university - china
学者数:
3.1W
论文数: 2.7W
被引数: 37
引用论文

引用论文

D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization
err2013-05-01
err337
errOAAI
errMota, Joao F. C.; Xavier, Joao M. F.; Aguiar, Pedro M. Q.; Pueschel, Markus
err分享
err收藏
A Network of Stationary Sensors and Mobile Robots for Distributed Ambient Intelligence
err2016-11-01
err10
PREAI
errPetitti, Antonio; Di Paola, Donato; Milella, Annalisa; Lorusso, Adele; Colella, Roberto; Attolico, Giovanni; Caccia, Massimo
err分享
err收藏
Communication-Censored Distributed Stochastic Gradient Descent
err2022-11-01
err11
errOAAI
errLi, Weiyu; Wu, Zhaoxian; Chen, Tianyi; Li, Liping; Ling, Qing
err分享
err收藏
Optimization Methods for Large-Scale Machine Learning大规模机器学习的优化方法
err2018-05-08
err1.8K
errOAAI
errBottou, Leon; Curtis, Frank E.; Nocedal, Jorge
err分享
err收藏
Optimal distributed stochastic mirror descent for strongly convex optimization
err2018-04-01
err115
errOAAI
errYuan, Deming; Hong, Yiguang; Ho, Daniel W. C.; Jiang, Guoping
err分享
err收藏
学者 查看更多内容