返回
Gradient-free algorithms based on weight-balancing for online distributed optimisation
DOI:10.1080/00207721.2025.2538736.png)
摘要
En 中文
The paper explores convex optimisation in online distributed bandit scenarios across directed graphs that vary over time. The architecture of online optimisation with convex function can be seen as a structured and repeated process in which each online participant can obtain the loss function after making a decision, and then evaluate the performance of this algorithm by optimising the gap in total loss obtained by the decision maker after making a decision and the total loss caused by the best decision, that is, the regret upper bound. Our research focuses on scenarios where decision-makers can't directly obtain complete gradient information, while the interaction information is established on time-varying directed imbalanced networks, with their graph matrices being non-doubly stochastic. In response to these challenges, we propose two approximate gradient methods considering stochastic perturbations, combined with a weight-balancing technique, to develop two projection-free online optimisation algorithms. Specifically, by selecting appropriate step sizes, the algorithms can achieve consensus among the estimates and obtain sublinear regret under the objective function's strong convexity. Furthermore, we validate the effectiveness of our algorithms by means of numerical analyses.
Keyword:
Distributed algorithms
gradient-free algorithms
online convex optimisation
weight-balancing techniques
期刊
I
IF:
4.6
论文数:
1.1K
被引数:
7.3K
机构
引用论文
Initialization-free distributed coordination for economic dispatch under varying loads and generator commitment
AUTOMATICA
IF5.9
Distributed Projection Subgradient Algorithm Over Time-Varying General Unbalanced Directed Graphs时变一般不平衡有向图上的分布式投影次梯度算法

