arrow
返回

Distributed Stochastic Proximal Algorithm With Random Reshuffling for Nonsmooth Finite-Sum Optimization

delete2024-03-01
delete3
delete
OA
AI
X
Xia Jiang
X
Xianlin Zeng
孙
孙健 (Jian Sun) *
陈
陈杰 (Jie Chen)
L
Lihua Xie
DOI:10.1109/TNNLS.2022.3201711delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The nonsmooth finite-sum minimization is a fundamental problem in machine learning. This article develops a distributed stochastic proximal-gradient algorithm with random reshuffling to solve the finite-sum minimization over time-varying multiagent networks. The objective function is a sum of differentiable convex functions and nonsmooth regularization. Each agent in the network updates local variables by local information exchange and cooperates to seek an optimal solution. We prove that local variable estimates generated by the proposed algorithm achieve consensus and are attracted to a neighborhood of the optimal solution with an O((1/T)+(1/root T)) convergence rate, where T is the total number of iterations. Finally, some comparative simulations are provided to verify the convergence performance of the proposed algorithm.
Keyword:
Distributed optimization
proximal operator
random reshuffling (RR)
stochastic algorithm
time-varying graphs

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
T
tongji university
学者数:
7.9W
论文数: 6.0W
被引数: 98
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Stability analysis of distributed convex optimization under persistent attacks: A hybrid systems approach
err2020-01-01
err36
errOAAI
errWang, Xue-Fang; Teel, Andrew R.; Liu, Kun-Zhi; Sun, Xi-Ming
err分享
err收藏
Distributed fixed step-size algorithm for dynamic economic dispatch with power flow limits
err2020-10-28
err12
PREAI
errWang, Kun; Fu, Zao; Xu, Qian; Chen, Duxin; Wang, Lei; Yu, Wenwu
err分享
err收藏
学者 查看更多内容