Distributed Semi-Supervised Learning With Consensus Consistency on Edge Devices

doi:10.1109/TPDS.2023.3340707

Distributed Semi-Supervised Learning With Consensus Consistency on Edge Devices

2024-02-01

2

PRE

AI

DOI：10.1109/TPDS.2023.3340707

Original

Original request for help

Save

Abstract

En 中文

Distributed learning has been increasingly studied in edge computing, enabling edge devices to learn a model collaboratively without exchanging their private data. However, existing approaches assume the private data owned by edge devices are all labeled while the reality is that massive private data are unlabeled and remain to be utilized, which leads to suboptimal performance. To overcome this limitation, we study a new practical problem, Distributed Semi-Supervised Learning (DSSL), to learn models collaboratively with mixed private labeled and unlabeled data on each device. We also propose a novel method DistMatch that exploits private unlabeled data by self-training on each device with the help of models from neighboring devices. DistMatch generates pseudo-labels for unlabeled data by properly averaging the predictions of these received models. Furthermore, to avoid self-training with wrong pseudo-labels, DistMatch proposes a consensus consistency loss to filter pseudo-labels with high consensus and force the output of the trained model to be consistent with these pseudo-labels. Extensive evaluation results via our self-developed testbed indicate the proposed method outperforms all baselines on commonly used image classification benchmark datasets.

Keywords:

Data models

Computational modeling

Servers

Training

Distributed databases

Semisupervised learning

Predictive models

Consistency regularization

distributed machine learning

semi-supervised learning

Distributed Semi-Supervised Learning With Consensus Consistency on Edge Devices

Abstract

Journal

Organization