.png){kind=icon}
返回
Stochastic Strongly Convex Optimization via Distributed Epoch Stochastic Gradient Algorithm
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2020.3004723.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article considers the problem of stochastic strongly convex optimization over a network of multiple interacting nodes. The optimization is under a global inequality constraint and the restriction that nodes have only access to the stochastic gradients of their objective functions. We propose an efficient distributed non-primal-dual algorithm, by incorporating the inequality constraint into the objective via a smoothing technique. We show that the proposed algorithm achieves an optimal O((1)/(T)) (T is the total number of iterations) convergence rate in the mean square distance from the optimal solution. In particular, we establish a high probability bound for the proposed algorithm, by showing that with a probability at least 1 - delta, the proposed algorithm converges at a rate of O(ln(ln(T)/delta)/T). Finally, we provide numerical experiments to demonstrate the efficacy of the proposed algorithm.
Keyword:
Convergence rate
distributed stochastic strongly optimization
epoch gradient descent
inequality constraint
multiagent systems
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
.png){kind=icon}
分享收藏
分享收藏
查看更多内容