arrow
返回

Federated Active Semi-Supervised Learning With Communication Efficiency

delete2023-11-01
delete3
PRE
AI
C
Chen Zhang
Y
Yu Xie *
H
Hang Bai
B
Bin Yu
Y
Yuan Gao
DOI:10.1109/TSMC.2023.3286485delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Federated learning (FL) unites multiple participants to collaboratively learn a global consensus model on the centralized server by aggregating their individual models trained locally on clients. To meet the goal of obtaining an optimal model, sufficient labeled data and myriad communications are required during training. However, the major problems are the limited budget for manually annotating unlabeled instances and the restricted bandwidth of server and clients. This article presents a communication-efficient federated active semi-supervised learning (CEFedASSL) framework that unites active learning (AL) clients and a semi-supervised learning (SSL) client to train models on unlabeled data while achieving communication efficiency. In each AL client, different query strategies are, respectively, applied for the local model to obtain a more robust model and query only the optimal samples which significantly reduces the cost of annotation. Subsequently, these optimal samples are encrypted as input to fine-tune the pretrained model of the SSL client by performing self-training, thereby enhancing the model performance while preserving the privacy of data. Furthermore, we propose an efficient selective aggregation strategy to reduce the communication cost between clients and the server. Empirical experiments on four different learning tasks demonstrate that the proposed CEFedASSL distinctively outperforms the common FL algorithms in terms of both model performance and communication costs.
Keyword:
Active learning (AL)
communication efficiency
efficient selective aggregation
federated learning (FL)
semi-supervised learning (SSL)

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

S
Shanxi University
学者数:
1.3W
论文数: 8.4K
被引数: 1.2W
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
err分享
err收藏
err分享
err收藏
Unwinding of the uniform lying helix structure in cholesteric liquid crystals next to a spatially uniform aligning surface
err2009-10-27
err0
PREAI
errPatrick S. Salter; Giovanni Carbone; Sharon A. Jewell; Steve J. Elston; Peter Raynes
err分享
err收藏
Retrospective study on PET–SPECT imaging in a large cohort of myotonic dystrophy type 1 patients
err2010-09-15
err0
PREAI
errVincenzo Romeo; E. Pegoraro; F. Squarzanti; G. Sorarù; C. Ferrati; M. Ermani; P. Zucchetta; F. Chierichetti; C. Angelini
err分享
err收藏
学者 查看更多内容