.png){kind=icon}
返回
Adaptive asynchronous federated learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.future.2023.11.001.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Federated Learning enables data owners to train an artificial intelligence model collaboratively while keeping all the training data locally, reducing the possibility of personal data breaches. However, the heterogeneity of local resources and dynamic characteristics of federated learning systems bring new challenges hindering the development of federated learning techniques. To this end, we propose an Adaptive Asynchronous Federated Learning scheme with Momentum, called FedAAM, comprising an adaptive weight allocation algorithm and a novel asynchronous federated learning framework. Firstly, we dynamically allocate weights for the global model update using an adaptive weight allocation strategy that can improve the convergence rate of models in asynchronous federated learning systems. Then, targeting the challenges mentioned previously, we proposed two new asynchronous global update rules based on the differentiated strategy, which is an essential component of the proposed novel federated learning framework. Furthermore, our asynchronous federated learning framework introduces the historical global update direction (i.e., global momentum) into the global update operation, aiming at improving training efficiency. Moreover, we prove that the model under the FedAAM scheme can achieve a sublinear convergence rate. Extensive experiments on real-world datasets demonstrate that the FedAAM scheme outperforms representative synchronous and asynchronous federated learning schemes (i.e., FedAvg and FedAsync) regarding the model's convergence rate and capacity to deal with dynamic systems.
Keyword:
Federated learning
Asynchronous aggregation
Distributed machine learning
Momentum
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge ComputingFedSA: 异构边缘计算中的半异步联邦学习机制
OAAI
.png){kind=icon}
OAAI分享收藏FedSA: A staleness-aware asynchronous Federated Learning algorithm with non-IID dataFedSA: 一种非IID数据的陈旧感知异步联邦学习算法
PREAI
分享收藏Dynamic and adaptive fault-tolerant asynchronous federated learning using volunteer edge devices
OAAI
OAAI分享收藏Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective无线联合学习网络中的客户端选择和带宽分配: 长期观点OAAI
OAAI分享收藏Clustered Federated Learning: Model-Agnostic Distributed Multitask Optimization Under Privacy Constraints集群联邦学习: 隐私约束下的模型不可知的分布式多任务优化OAAI
OAAI分享收藏
查看更多内容