arrow
返回

Gradient-free algorithms based on weight-balancing for online distributed optimisation

delete2025-08-05
delete0
PRE
AI
J
Juan Shang
莫立坡 封面图
莫立坡 (Lipo Mo) *
M
Min Zuo
Y
Yaowen Wang
DOI:10.1080/00207721.2025.2538736delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The paper explores convex optimisation in online distributed bandit scenarios across directed graphs that vary over time. The architecture of online optimisation with convex function can be seen as a structured and repeated process in which each online participant can obtain the loss function after making a decision, and then evaluate the performance of this algorithm by optimising the gap in total loss obtained by the decision maker after making a decision and the total loss caused by the best decision, that is, the regret upper bound. Our research focuses on scenarios where decision-makers can't directly obtain complete gradient information, while the interaction information is established on time-varying directed imbalanced networks, with their graph matrices being non-doubly stochastic. In response to these challenges, we propose two approximate gradient methods considering stochastic perturbations, combined with a weight-balancing technique, to develop two projection-free online optimisation algorithms. Specifically, by selecting appropriate step sizes, the algorithms can achieve consensus among the estimates and obtain sublinear regret under the objective function's strong convexity. Furthermore, we validate the effectiveness of our algorithms by means of numerical analyses.
Keyword:
Distributed algorithms
gradient-free algorithms
online convex optimisation
weight-balancing techniques

期刊

I
International Journal of Systems Science
IF:
4.6
论文数:
1.1K
被引数:
7.3K

机构

B
Beijing Technology and Business University
学者数:
4.1K
论文数: 1.7K
被引数: 1.6W
B
Beijing Wuzi University
学者数:
498
论文数: 473
被引数: 374
引用论文

引用论文

Quantized Distributed Online Projection-Free Convex Optimization
err2023-01-01
err0
errOAAI
errWentao Zhang; Yang Shi; Baoyong Zhang; Kaihong Lu; Deming Yuan
err分享
err收藏
学者 查看更多内容