arrow
Return

Edge-Based Communication Optimization for Distributed Federated Learning

delete2022-07-01
delete53
PRE
AI
王
王田 (Tian Wang)
刘
刘艳 (Yan Liu)
X
Xi Zheng
H
Hong‐Ning Dai
W
Weijia Jia
M
Mande Xie *
DOI:10.1109/TNSE.2021.3083263delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated learning can achieve distributed machine learning without sharing privacy and sensitive data of end devices. However, high concurrent access to cloud servers increases the transmission delay of model updates. Some local models may be unnecessary with an opposite gradient from the global model, thus incurring many additional communication costs. Existing work mainly focuses on reducing communication rounds or cleaning local defect data, and neither takes into account latency associated with high server concurrency. To this end, we study an edge-based communication optimization framework to reduce the number of end devices directly connected to the parameter server while avoiding uploading unnecessary local updates. Specifically, we cluster devices in the same network location and deploy mobile edge nodes in different network locations to serve as hubs for cloud and end devices communications, thereby avoiding the latency associated with high server concurrency. Meanwhile, we propose a method based on cosine similarity to filter out unnecessary models, thus avoiding unnecessary communication. Experimental results show that compared with traditional federated learning, the proposed scheme reduces the number of local updates by 60%, and the convergence speed of the evaluated model increases by 10.3%.
Keywords:
Servers
Data models
Optimization
Collaborative work
Computational modeling
Training
Data privacy
Federated learning
Communication optimization
Mobile edge nodes
Model filtering
Clustering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
IEEE Transactions on Network Science and Engineering
IF:
7.9
Papers:
2.6K
Citations:
10.0K

Organization

B
Beijing Normal University
Scholars:
3.3W
Papers: 2.7W
Citations: 4.2W
H
huaqiao university
Scholars:
1.1W
Papers: 7.1K
Citations: 131
Z
Zhejiang Gongshang University
Scholars:
6.6K
Papers: 4.9K
Citations: 8.1K
M
Macquarie University
Scholars:
1.2W
Papers: 1.5W
Citations: 2.2W
researcher View more organizations
Cited Papers

Cited Papers

Federated Machine Learning: Concept and Applications
err2019-01-28
err5.5K
PREAI
errYang, Qiang; Liu, Yang; Chen, Tianjian; Tong, Yongxin
errShare
errSave
Movement-Based Solutions to Energy Limitation in Wireless Sensor Networks: State of the Art and Future Trends
err2021-03-01
err44
PREAI
errLiu, Xuxun; Obaidat, Mohammad S.; Lin, Chi; Wang, Tian; Liu, Anfeng
errShare
errSave
errShare
errSave
Big Data Cleaning Based on Mobile Edge Computing in Industrial Sensor-Cloud
err2020-02-01
err134
PREAI
errWang, Tian; Ke, Haoxiong; Zheng, Xi; Wang, Kun; Sangaiah, Arun Kumar; Liu, Anfeng
errShare
errSave
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
err2019-06-01
err1.4K
errOAAI
errWang, Shiqiang; Tuor, Tiffany; Salonidis, Theodoros; Leung, Kin K.; Makaya, Christian; He, Ting; Chan, Kevin
errShare
errSave
Falcon: Addressing Stragglers in Heterogeneous Parameter Server Via Multiple Parallelism
err2021-01-01
err26
PREAI
errZhou, Qihua; Guo, Song; Lu, Haodong; Li, Li; Guo, Minyi; Sun, Yanfei; Wang, Kun
errShare
errSave
researcher View more