arrow
返回

AutoSF: Adaptive Distributed Model Training in Dynamic Edge Computing

delete2024-06-01
delete2
PRE
AI
杨
杨磊 (Lei Yang) *
J
Jinru Chen
J
Jiannong Cao
DOI:10.1109/TMC.2023.3323456delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributed learning on edges aims at training the AI model collaboratively in a network of edge devices via frequent model aggregations. Achieving the desired training performance requires the aggregation structure and frequency to fit well with the dynamic edge environment. Existing works often consider the optimization of either aggregation structure or frequency, assuming that the edge environment is stable and deterministic. In this paper, we propose a novel approach, AutoSF, to automatically optimize the aggregation structure and frequency jointly in dynamic edge computing so as to minimize the global loss function. The main idea of AutoSF is that when the edge environment changes, the automated machine learning approach is triggered to find out the near-optimal aggregation structure and frequency that adapt to time-varying edge resources. When the environment keeps unchanged, a heuristic approach is used to tune the aggregation structure and frequency to further tame the heterogeneity caused by data distributions. We validate the effectiveness of AutoSF via numerical experiments with real datasets on our self-developed edge computing testbed. Evaluation results demonstrate that AutoSF outperforms the benchmark approaches by up to 16.3x speedups in convergence speed and 31.0% increases in training accuracy.
Keyword:
Training
Computational modeling
Adaptation models
Performance evaluation
Edge computing
Convergence
Bandwidth
Aggregation frequency
aggregation structure
distributed machine learning
edge intelligence

期刊

IEEE Transactions on Mobile Computing 封面图
IEEE Transactions on Mobile Computing
IF:
9.2
论文数:
5.8K
被引数:
1.8W

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Dynamic Edge Association and Resource Allocation in Self-Organizing Hierarchical Federated Learning Networks
err2021-12-01
err95
errOAAI
errLim, Wei Yang Bryan; Ng, Jer Shyuan; Xiong, Zehui; Niyato, Dusit; Miao, Chunyan; Kim, Dong In
err分享
err收藏
err分享
err收藏
Vehicular Delay-Tolerant Networks for Smart Grid Data Management Using Mobile Edge Computing
err2016-10-01
err155
PREAI
errKumar, Neeraj; Zeadally, Sherali; Rodrigues, Joel J. P. C.
err分享
err收藏
学者 查看更多内容