.png){kind=icon}
返回
Asynchronous Speedup in Decentralized Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2024.3454386.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In decentralized optimization, nodes of a communication network each possess a local objective function, and communicate using gossip-based methods in order to minimize the average of these per-node functions. While synchronous algorithms are heavily impacted by a few slow nodes or edges in the graph (the straggler problem), their asynchronous counterparts are notoriously harder to parameterize. Indeed, their convergence properties for networks with heterogeneous communication and computation delays have defied analysis so far. In this article, we use a continuized framework to analyze asynchronous algorithms in networks with delays. Our approach yields a precise characterization of convergence time and of its dependence on heterogeneous delays in the network. Our continuized framework benefits from the best of both continuous and discrete worlds: the algorithms it applies to are based on event-driven updates. They are thus essentially discrete, and hence, readily implementable. Yet their analysis is essentially in continuous time, relying in part on the theory of delayed ordinary differential equations. Our algorithms moreover achieve an asynchronous speedup: their rate of convergence is controlled by the eigengap of the network graph weighted by local delays instead of the network-wide worst-case delay as in previous analyses. Our methods thus enjoy improved robustness to stragglers.
Keyword:
Delays
Optimization
Convergence
Laplace equations
Stochastic processes
Robustness
Protocols
Asynchronous
decentralized
gossip
optimization
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
Lyapunov-Krasovskii functional for uniform stability of coupled differential-functional equationsLyapunov-krasovskii泛函，用于耦合微分泛函方程的一致稳定性.png)
AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏分享收藏Affinity labeling of bovine carboxypeptidase A γLeu by N-bromoacetyl-N-methyl-L-phenylalanine. I. Kinetics of inactivationBiochemistry
BiochemistryIF0
PREAI
分享收藏
查看更多内容