arrow
Return

Federated Active Semi-Supervised Learning With Communication Efficiency

delete2023-11-01
delete3
PRE
AI
C
Chen Zhang
Y
Yu Xie *
H
Hang Bai
B
Bin Yu
Y
Yuan Gao
DOI:10.1109/TSMC.2023.3286485delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated learning (FL) unites multiple participants to collaboratively learn a global consensus model on the centralized server by aggregating their individual models trained locally on clients. To meet the goal of obtaining an optimal model, sufficient labeled data and myriad communications are required during training. However, the major problems are the limited budget for manually annotating unlabeled instances and the restricted bandwidth of server and clients. This article presents a communication-efficient federated active semi-supervised learning (CEFedASSL) framework that unites active learning (AL) clients and a semi-supervised learning (SSL) client to train models on unlabeled data while achieving communication efficiency. In each AL client, different query strategies are, respectively, applied for the local model to obtain a more robust model and query only the optimal samples which significantly reduces the cost of annotation. Subsequently, these optimal samples are encrypted as input to fine-tune the pretrained model of the SSL client by performing self-training, thereby enhancing the model performance while preserving the privacy of data. Furthermore, we propose an efficient selective aggregation strategy to reduce the communication cost between clients and the server. Empirical experiments on four different learning tasks demonstrate that the proposed CEFedASSL distinctively outperforms the common FL algorithms in terms of both model performance and communication costs.
Keywords:
Active learning (AL)
communication efficiency
efficient selective aggregation
federated learning (FL)
semi-supervised learning (SSL)

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

S
Shanxi University
Scholars:
1.3W
Papers: 8.4K
Citations: 1.2W
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
errShare
errSave
errShare
errSave
Unwinding of the uniform lying helix structure in cholesteric liquid crystals next to a spatially uniform aligning surface
err2009-10-27
err0
PREAI
errPatrick S. Salter; Giovanni Carbone; Sharon A. Jewell; Steve J. Elston; Peter Raynes
errShare
errSave
Retrospective study on PET–SPECT imaging in a large cohort of myotonic dystrophy type 1 patients
err2010-09-15
err0
PREAI
errVincenzo Romeo; E. Pegoraro; F. Squarzanti; G. Sorarù; C. Ferrati; M. Ermani; P. Zucchetta; F. Chierichetti; C. Angelini
errShare
errSave
researcher View more