arrow
Return

Coded Federated Learning for Communication-Efficient Edge Computing: A Survey

delete2024-01-01
delete0
delete
OA
AI
Y
Yiqian Zhang
T
Tianli Gao
李聪端 (Congduan Li) *
C
Chee Wei Tan
DOI:10.1109/OJCOMS.2024.3423362delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the era of artificial intelligence and big data, the demand for data processing has surged, leading to larger datasets and computation capability. Distributed machine learning (DML) has been introduced to address this challenge by distributing tasks among multiple workers, reducing the resources required for each worker. However, in distributed systems, the presence of slow machines, commonly known as stragglers, or failed links can lead to prolonged runtimes and diminished performance. This survey explores the application of coding techniques in DML and coded edge computing in the distributed system to enhance system speed, robustness, privacy, and more. Notably, the study delves into coding in Federated Learning (FL), a specialized distributed learning system. Coding involves introducing redundancy into the system and identifying multicast opportunities. There exists a tradeoff between computation and communication costs. The survey establishes that coding is a promising approach for building robust and secure distributed systems with low latency.
Keywords:
Encoding
Servers
Computational modeling
Training
Federated learning
Data models
Surveys
Coding
distributed machine learning
federated learning
distributed computing
edge computing

Journal

I
IEEE Open Journal of the Industrial Electronics Society
IF:
4.3
Papers:
1.7K
Citations:
991

Organization

S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W