arrow
返回

Pretraining Client Selection Algorithm Based on a Data Distribution Evaluation Model in Federated Learning

delete2024-01-01
delete1
delete
OA
AI
C
Chang Xu
H
Hong Liu *
K
Kexin Li
W
W. Feng
Q
Qi Wei
DOI:10.1109/ACCESS.2024.3396279delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Federated Learning (FL) allows task initiators (servers) to utilize data from task participants (clients) to train machine learning models while protecting data privacy. However, in the FL system, when the client data are non-independently identically distributed (Non-IID), appropriate metrics are chosen to accurately evaluate the quality of the client data, accordingly to select a reasonable subset of clients, and thus ensure the accuracy of the FL aggregation model. In this paper, based on the experimental results, a data distribution evaluation model is proposed, which is based on two metrics: the volume of client data and its increment and the balance of global client data. This data distribution evaluation model enables more accurate evaluation of clients with Non-IID characteristics. Based on this evaluation model, this paper further proposes an FL client subset selection algorithm. This algorithm accurately evaluates the data value of each client, enabling the server to select the most valuable subset of clients before FL training, thus improving the accuracy of the federated learning aggregation model in scenarios with Non-IID client data. When training the FL aggregation model using the proposed method on datasets composed of CIFAR-10, Fashion-MNIST, and DEAP distributions, compared to the optimal baseline, the average precision scores increased by 5.99%, 4.79%, and 4.29% respectively. The improvement in accuracy is more pronounced in scenarios with Non-IID data, such as in the DEAP dataset distribution with the highest Non-IID degree, where the accuracy increased by 5.30% compared to the optimal baseline.
Keyword:
Client selection
data distribution
federated learning
machine learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

Z
zhejiang university of technology
学者数:
3.3W
论文数: 2.0W
被引数: 22
H
Hangzhou City University
学者数:
2.2K
论文数: 2.0K
被引数: 1.0K
引用论文

引用论文

Data-Centric Client Selection for Federated Learning Over Distributed Edge Networks
err2023-02-01
err24
PREAI
errSaha, Rituparna; Misra, Sudip; Chakraborty, Aishwariya; Chatterjee, Chandranath; Deb, Pallav Kumar
err分享
err收藏
err分享
err收藏
Total Synthesis of (–)‐Epothilone B: An Extension of the Suzuki Coupling Method and Insights into Structure–Activity Relationships of the Epothilones
err2003-12-22
err0
PREAI
errDai‐Shi Su; Dongfang Meng; Peter Bertinato; Aaron Balog; Erik J. Sorensen; Samuel J. Danishefsky; Yu‐Huang Zheng; Ting‐Chao Chou; Lifeng He; Susan B. Horwitz
err分享
err收藏
err分享
err收藏
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
err分享
err收藏
VFedCS: Optimizing Client Selection for Volatile Federated Learning
err2022-12-15
err15
PREAI
errShi, Fang; Hu, Chunchao; Lin, Weiwei; Fan, Lisheng; Huang, Tiansheng; Wu, Wentai
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning
err2022-08-01
err119
PREAI
errDeng, Yongheng; Lyu, Feng; Ren, Ju; Wu, Huaqing; Zhou, Yuezhi; Zhang, Yaoxue; Shen, Xuemin
err分享
err收藏
学者 查看更多内容