arrow
返回

Learning sample-aware threshold for semi-supervised learning

delete2024-01-18
delete1
PRE
AI
Q
Qi Wei *
L
Lei Feng
H
Haoliang Sun
R
Ren Wang
R
Rundong He
尹义龙 封面图
尹义龙 (Yilong Yin)
DOI:10.1007/s10994-023-06425-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Pseudo-labeling methods are popular in semi-supervised learning (SSL). Their performance heavily relies on a proper threshold to generate hard labels for unlabeled data. To this end, most existing studies resort to a manually pre-specified function to adjust the threshold, which, however, requires prior knowledge and suffers from the scalability issue. In this paper, we propose a novel method named Meta-Threshold, which learns a dynamic confidence threshold for each unlabeled instance and does not require extra hyperparameters except a learning rate. Specifically, the instance-level confidence threshold is automatically learned by an extra network in a meta-learning manner. Considering limited labeled data as meta-data, the overall training objective of the classifier network and the meta-net can be formulated as a nested optimization problem that can be solved by a bi-level optimization scheme. Furthermore, by replacing the indicator function existed in the pseudo-labeling with a surrogate function, we theoretically provide the convergence of our training procedure, while discussing the training complexity and proposing a strategy to reduce its time cost. Extensive experiments and analyses demonstrate the effectiveness of our method on both typical and imbalanced SSL tasks.
Keyword:
Semi-supervised learning
Confidence thresholds
Meta-learning
Bi-level optimization

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
S
shandong university
学者数:
9.4W
论文数: 6.4W
被引数: 94
引用论文

引用论文

Proteomic Analysis of Human Lens Epithelial Cells Exposed to Microwaves
err2007-12-21
err0
PREAI
errHong-Wu Li; Ke Yao; Hong-Ying Jin; Li-Xia Sun; De-Qiang Lu; Yi-Bo Yu
err分享
err收藏
Spatial variability of airborne and settled dust in a piggery
err1991-09-01
err0
PREAI
errE.M. Barber; J.R. Dawson; V.A. Battams; R.A.C. Nicol
err分享
err收藏
High-Temperature Recovery of Tungsten after Neutron Irradiation
err1968-12-15
err0
PREAI
errL. K. Keys; J. P. Smith; J. Moteff
err分享
err收藏
Learning to rectify for robust learning with noisy labels学习纠正与嘈杂标签的稳健学习
err2022-04-01
err27
errOAAI
errSun, Haoliang; Guo, Chenhui; Wei, Qi; Han, Zhongyi; Yin, Yilong
err分享
err收藏
没有更多内容