arrow
Return

Contribution-based Federated Learning client selection

delete2022-04-01
delete15
delete
OA
AI
林伟伟 cover
林伟伟 (Weiwei Lin) *
Y
Yinhai Xu
刘
刘波 (Bo Liu) *
D
Dongdong Li
T
Tiansheng Huang
F
Fang Shi
DOI:10.1002/int.22879delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated Learning (FL), as a privacy-preserving machine learning paradigm, has been thrusted into the limelight. As a result of the physical bandwidth constraint, only a small number of clients are selected for each round of FL training. However, existing client selection solutions (e.g., the vanilla random selection) typically ignore the heterogeneous data value of the clients. In this paper, we propose the contribution-based selection algorithm (Contribution-Based Exponential-weight algorithm for Exploration and Exploitation, CBE3), which dynamically updates the selection weights according to the impact of clients' data. As a novel component of CBE3, a scaling factor, which helps maintain a good balance between global model accuracy and convergence speed, is proposed to improve the algorithm's adaptability. Theoretically, we proved the regret bound of the proposed CBE3 algorithm, which demonstrates performance gaps between the CBE3 and the optimal choice. Empirically, extensive experiments conducted on Non-Independent Identically Distributed data demonstrate the superior performance of CBE3-with up to 10% accuracy improvement compared with K-Center and Greedy and up to 100% faster convergence compared with the Random algorithm.
Keywords:
client
contribution-based
EXP3
Federated Learning
global models
Non-Independent Identically Distributed

Journal

International Journal of Intelligent Systems cover
International Journal of Intelligent Systems
IF:
3.7
Papers:
3.1K
Citations:
8.1K

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

A multitarget backdooring attack on deep neural networks with random location trigger
err2021-12-28
err12
errOAAI
errXiao, Yu; Cong, Liu; Mingwen, Zheng; Yajie, Wang; Xinrui, Liu; Shuxiao, Song; Yuexuan, Ma; Jun, Zheng
errShare
errSave
errShare
errSave
Craniosynostosis in hyper-IgE-syndrome
err1985-11-01
err0
PREAI
errP. H. H�ger; E. Boltshauser; W. H. Hitzig
errShare
errSave
Adversarial attacks on deep-learning-based SAR image target recognition
err2020-07-01
err86
PREAI
errHuang, Teng; Zhang, Qixiang; Liu, Jiabao; Hou, Ruitao; Wang, Xianmin; Li, Ya
errShare
errSave
Binding theory and grammatical specific language impairment in children
err1997-03-01
err0
PREAI
errHeather K.J van der Lely; Linda Stollwerck
errShare
errSave
Electric vehicle automatic stop using wireless power transfer antennas
err2011-11-01
err0
PREAI
errPalakon Kotchapansompote; Yafei Wang; Takehiro Imura; Hiroshi Fujimoto; Yoichi Hon
errShare
errSave
researcher View more