arrow
Return

A Personalized Federated Learning Algorithm Based on Dynamic Weight Allocation

delete2025-01-25
delete0
delete
OA
AI
Y
Yazhi Liu
S
Siwei Li
W
Wei Li *
H
Hui Qian
H
H. R. Xia
DOI:10.3390/electronics14030484delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated learning is a privacy-preserving distributed machine learning paradigm. However, due to client data heterogeneity, the global model trained by a traditional federated averaging algorithm often exhibits poor generalization ability. To mitigate the impact of data heterogeneity, some existing research has proposed clustered federated learning, where clients with similar data distributions are grouped together to reduce interference from dissimilar clients. However, since the data distribution of clients is unknown, determining the optimal number of clusters is difficult, leading to reduced model convergence efficiency. To address this issue, this paper proposes a personalized federated learning algorithm based on dynamic weight allocation. First, each client is allowed to obtain a global model tailored to fit its local data distribution. During the client model aggregation process, the server first computes the similarity of model updates between clients and dynamically allocates aggregation weights to client models based on these similarities. Secondly, clients use the received exclusive global model to train their local models via the personalized federated learning algorithm. Extensive experimental results demonstrate that, compared to other personalized federated learning algorithms, the proposed method effectively improves model accuracy and convergence speed.
Keywords:
federated learning
personalized federated learning
data heterogeneity
clustered federated learning
model aggregation

Journal

Electronics cover
Electronics
IF:
2.6
Papers:
1.1W
Citations:
4.7W

Organization

N
North China University of Science and Technology
Scholars:
1.9K
Papers: 585
Citations: 5.2K
Cited Papers

Cited Papers

Federated Learning With Non-IID Data: A Survey
err2024-06-01
err44
PREAI
errLu, Zili; Pan, Heng; Dai, Yueyue; Si, Xueming; Zhang, Yan
errShare
errSave
FedALA: Adaptive Local Aggregation for Personalized Federated Learning
err2023-06-26
err0
errOAAI
errJianqing Zhang; Yang Hua; Hao Wang; Tao Song; Zhengui Xue; Ruhui Ma; Haibing Guan
errShare
errSave
Model optimization techniques in personalized federated learning: A survey
err2024-06-01
err6
PREAI
errSabah, Fahad; Chen, Yuwen; Yang, Zhen; Azam, Muhammad; Ahmad, Nadeem; Sarwar, Raheem
errShare
errSave
Federated Learning for Internet of Things: A Comprehensive Survey
err2021-01-01
err527
errOAAI
errNguyen, Dinh C.; Ding, Ming; Pathirana, Pubudu N.; Seneviratne, Aruna; Li, Jun; Poor, H. Vincent
errShare
errSave
Personalized Cross-Silo Federated Learning on Non-IID Data
err2021-05-18
err0
errOAAI
errYutao Huang; Lingyang Chu; Zirui Zhou; Lanjun Wang; Jiangchuan Liu; Jian Pei; Yong Zhang
errShare
errSave
researcher View more