.png){kind=icon}
返回
A Flexible Stochastic Multi-Agent ADMM Method for Large-Scale Distributed Optimization
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3120017.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
While applying stochastic alternating direction method of multiplier (ADMM) methods has become enormously potential in distributed applications, improving the algorithmic flexibility can bring huge benefits. In this paper, we propose a novel stochastic optimization method based on distributed ADMM method, called Flex-SADMM. Specifically, we incorporate the variance reduced first-order information and the approximated second-order information for solving the subproblem of ADMM, which targets at the stable convergence and improving the accuracy of the search direction. Moreover, different from most ADMM based methods that require each computation node to perform the update in each iteration, we only require each computation node updates within a bounded iteration interval, this has significantly improved the flexibility. We further provide the theoretical results to guarantee the convergence of Flex-SADMM in the nonconvex optimization problems. These results show that our proposed method can successfully overcome the above challenges while the computational complexity is maintained low. In the empirical study, we have verified the effectiveness and the improved flexibility of our proposed method.
Keyword:
Distributed optimization
ADMM
variance reduction
Hessian approximation
flexibility
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Millimeter-Wave Beamformed Full-Dimensional MIMO Channel Estimation Based on Atomic Norm Minimization基于原子范数最小化的毫米波波束赋形全维MIMO信道估计
OAAI
.png){kind=icon}
OAAI分享收藏Effect of ω-3 fatty acids on rectal mucosal cell proliferation in subjects at risk for colon cancerΩ-3脂肪酸对结肠癌高危人群直肠黏膜细胞增殖的影响OAAI
OAAI分享收藏
查看更多内容