.png){kind=icon}
返回
Coded Computing for Low-Latency Federated Learning Over Wireless Edge Networks
.png){kind=icon}
OA
AI
DOI：10.1109/JSAC.2020.3036961.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Federated learning enables training a global model from data located at the client nodes, without data sharing and moving client data to a centralized server. Performance of federated learning in a multi-access edge computing (MEC) network suffers from slow convergence due to heterogeneity and stochastic fluctuations in compute power and communication link qualities across clients. We propose a novel coded computing framework, CodedFedL, that injects structured coding redundancy into federated learning for mitigating stragglers and speeding up the training procedure. CodedFedL enables coded computing for non-linear federated learning by efficiently exploiting distributed kernel embedding via random Fourier features that transforms the training task into computationally favourable distributed linear regression. Furthermore, clients generate local parity datasets by coding over their local datasets, while the server combines them to obtain the global parity dataset. Gradient from the global parity dataset compensates for straggling gradients during training, and thereby speeds up convergence. For minimizing the epoch deadline time at the MEC server, we provide a tractable approach for finding the amount of coding redundancy and the number of local data points that a client processes during training, by exploiting the statistical properties of compute as well as communication delays. We also characterize the leakage in data privacy when clients share their local parity datasets with the server. Additionally, we analyze the convergence rate and iteration complexity of CodedFedL under simplifying assumptions, by treating CodedFedL as a stochastic gradient descent algorithm. Finally, for demonstrating gains that CodedFedL can achieve in practice, we conduct numerical experiments using practical network parameters and benchmark datasets, in which CodedFedL speeds up the overall training time by up to 15x in comparison to the benchmark schemes.
Keyword:
Servers
Training
Collaborative work
Encoding
Distributed databases
Convergence
Redundancy
Distributed computing
machine learning
edge computing
wireless communication
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
17.2
论文数:
6.4K
被引数:
3.1W
机构
引用论文
Optimizing Joint Erasure- and Error-Correction Coding for Wireless Packet Transmissions优化无线分组传输的联合擦除和纠错编码
PREAI
分享收藏Priority Control in Communication Networks for Accuracy-Freshness Tradeoff in Real-Time Road-Traffic Information Delivery.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration多接入边缘计算: 新兴5g网络边缘云架构与编排综述OAAI
OAAI分享收藏
查看更多内容