.png){kind=icon}
返回
Coded Stochastic ADMM for Decentralized Consensus Optimization With Edge Computing
.png){kind=icon}
OA
AI
DOI：10.1109/JIOT.2021.3058116.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones, and vehicles. Due to the limitations of communication costs and security requirements, it is of paramount importance to analyze information in a decentralized manner instead of aggregating data to a fusion center. To train large-scale machine learning models, edge/fog computing is often leveraged as an alternative to centralized learning. We consider the problem of learning model parameters in a multiagent system with data locally processed via distributed edge nodes. A class of minibatch stochastic alternating direction method of multipliers (ADMMs) algorithms is explored to develop the distributed learning model. To address two main critical challenges in distributed learning systems, i.e., communication bottleneck and straggler nodes (nodes with slow responses), error-control-coding-based stochastic incremental ADMM is investigated. Given an appropriate minibatch size, we show that the minibatch stochastic ADMM-based method converges in a rate of O(1/root k), where k denotes the number of iterations. Through numerical experiments, it is revealed that the proposed algorithm is communication efficient, rapidly responding, and robust in the presence of straggler nodes compared with state-of-the-art algorithms.
Keyword:
Alternating direction method of multipliers (ADMMs)
coded edge computing
consensus optimization
decentralized learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems6g无线系统的愿景: 应用，趋势，技术和开放研究问题.png)
IEEE NETWORKOAAI
IEEE NETWORKIF6.3
OAAI分享收藏A Cyclic Carbanionic Valence Isomer of a Carbocation: Diphosphino Analogs of DiaminocarbocationsScience
ScienceIF0
PREAI
分享收藏
查看更多内容