返回
Distributed online convex optimization with multiple coupled constraints: A double accelerated push-pull algorithm
DOI:10.1016/j.jfranklin.2023.10.041.png)
摘要
En 中文
This paper is concerned with the distributed online convex optimization problems with multiple coupled constraints over unbalanced digraphs, which are widely applied in diverse fields such as machine learning, smart grids, and resource allocation problems, etc. In such practical scenarios, multiple coupled constraints, where each coupled constraint might only contain a portion of all nodes, are more general and complex global coupled constraints. Additionally, due to certain constraint conditions such as energy and communication limitations, each node can exchange information with other nodes in an identical constraint. Besides, the network connectivity of practical constrained problems might be only confined to one type of weight matrices. By adopting an augmented Lagrangian method, the multiple coupled constrained optimization problem is converted into a saddle-point problem. To tackle this problem, a novel double accelerated push-pull (DAPP) algorithm is proposed which concurrently employs row-stochastic (RS) and column-stochastic (CS) weight matrices. Specifically, each node pushes gradient information weighted by CS matrices to out-neighbors, while pulls dual variables fused by RS matrices from in-neighbors. Combined with CS matrices, gradient tracking scheme is employed to promote the efficiency of tracking the averaged gradients. Furthermore, aiming at improving convergence rate, the heavy-ball method is used to update both primal and dual variables. Then, rigorous theoretical results indicate that obtains the sublinear bounds of regret and constraint violation. Finally, the plug-in electric vehicles (PEVs) charging problem is utilized demonstrate the validity of the proposed algorithm.
Keyword:
DECOMPOSITION
期刊
J
IF:
3.7
论文数:
6.5K
被引数:
1.5W
机构
引用论文
A decomposition method for large scale MILPs, with performance guarantees and a power system application
AUTOMATICA
IF5.9
Distributed Nesterov Gradient and Heavy-Ball Double Accelerated Asynchronous Optimization分布式Nesterov梯度和重球双加速异步优化
Distributed Projection Subgradient Algorithm Over Time-Varying General Unbalanced Directed Graphs时变一般不平衡有向图上的分布式投影次梯度算法
A Nesterov-Like Gradient Tracking Algorithm for Distributed Optimization Over Directed Networks用于有向网络上分布式优化的Nesterov类梯度跟踪算法

