返回
AutoSF: Adaptive Distributed Model Training in Dynamic Edge Computing
DOI:10.1109/TMC.2023.3323456.png)
摘要
En 中文
Distributed learning on edges aims at training the AI model collaboratively in a network of edge devices via frequent model aggregations. Achieving the desired training performance requires the aggregation structure and frequency to fit well with the dynamic edge environment. Existing works often consider the optimization of either aggregation structure or frequency, assuming that the edge environment is stable and deterministic. In this paper, we propose a novel approach, AutoSF, to automatically optimize the aggregation structure and frequency jointly in dynamic edge computing so as to minimize the global loss function. The main idea of AutoSF is that when the edge environment changes, the automated machine learning approach is triggered to find out the near-optimal aggregation structure and frequency that adapt to time-varying edge resources. When the environment keeps unchanged, a heuristic approach is used to tune the aggregation structure and frequency to further tame the heterogeneity caused by data distributions. We validate the effectiveness of AutoSF via numerical experiments with real datasets on our self-developed edge computing testbed. Evaluation results demonstrate that AutoSF outperforms the benchmark approaches by up to 16.3x speedups in convergence speed and 31.0% increases in training accuracy.
Keyword:
Training
Computational modeling
Adaptation models
Performance evaluation
Edge computing
Convergence
Bandwidth
Aggregation frequency
aggregation structure
distributed machine learning
edge intelligence
期刊
IF:
9.2
论文数:
5.8K
被引数:
1.8W
机构
引用论文
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing边缘智能: 用边缘计算铺平人工智能的最后一英里
PROCEEDINGS OF THE IEEE
IF25.9
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated LearningIn-Edge AI: 通过联合学习实现移动边缘计算、缓存和通信的智能化
IEEE NETWORK
IF6.3
Permissioned Blockchain and Edge Computing Empowered Privacy-Preserving Smart Grid Networks授权区块链和边缘计算支持隐私保护的智能电网网络

