S2Match: Self-paced sampling for data-limited semi-supervised learning

Dayan Guan

doi:10.1016/j.patcog.2024.111121

S2Match: Self-paced sampling for data-limited semi-supervised learning

2025-03-01

0

PRE

AI

Abdulmotaleb El Saddik

S

Shijian Lu *

DOI：10.1016/j.patcog.2024.111121

Original

Original request for help

Save

Abstract

En 中文

Data-limited semi-supervised learning tends to be severely degraded by miscalibration (i.e., misalignment between confidence and correctness of predicted pseudo labels) and stuck at poor local minima while learning from the same set of over-confident yet incorrect pseudo labels repeatedly. We design a simple and effective self-paced sampling technique that can greatly alleviate the impact of miscalibration and learn more accurate semi-supervised models from limited training data. Instead of employing static or dynamic confidence thresholds which is sensitive to miscalibration, the proposed self-paced sampling follows a simple linear policy to select pseudo labels which eases repeated learning from the same set of falsely predicted pseudo labels at the early training stage and lowers the chance of being stuck at local minima effectively. Despite its simplicity, extensive evaluations over multiple data-limited semi-supervised tasks show the proposed self-paced sampling outperforms the state-of-the-art consistently by large margins.

Keywords:

Semi-supervised learning

Self-paced learning

Miscalibration

Image classification

Limited data

S2Match: Self-paced sampling for data-limited semi-supervised learning

Abstract

Journal

Organization