arrow
返回

Enhancing Active Learning With Semi-Supervised Loss Prediction Modules

delete2024-01-01
delete0
delete
OA
AI
S
Sekjin Hwang
J
Jinwoo Choi *
J
Joonsoo Choi *
DOI:10.1109/ACCESS.2024.3449449delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, deep learning techniques have substantially improved across numerous applications. However, these advancements come with the requirement for extensive human-labeled data, leading to high labeling costs. Active learning addresses this issue by reducing labeling costs. The primary goal of active learning is to select the most informative data for model training. Among the various active learning strategies, uncertainty-based methods are most prevalent. These methods focus on data points where the model's predictions are uncertain, identifying them as key candidates for additional learning. Recently, uncertainty-based methods have been integrated into deep learning, mainly through learning loss-based methods. These methods involve training a loss prediction module to predict learning loss, using the predicted loss as an indicator of uncertainty. While learning loss-based methods generally perform well, they struggle with more challenging tasks. A notable limitation of previous learning loss-based methods is that they use the same labeled data to train the loss prediction module and the task model. However, since the actual data to be predicted is unlabeled, a loss prediction module trained exclusively on labeled data has inherent limitations. In this study, we propose a new training method for the loss prediction module that is robust to unlabeled data. Our approach employs semi-supervised learning techniques to incorporate unlabeled datasets into the training process of the loss prediction module. Experimental results demonstrate that our proposed method effectively trains a robust loss prediction module, achieving state-of-the-art performance across various datasets.
Keyword:
Training data
Data models
Uncertainty
Labeling
Semisupervised learning
Deep learning
Learning systems
Active learning
data efficient learning
learning loss based method
pool-based sampling

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
kookmin university
学者数:
3.0K
论文数: 3.3K
被引数: 2
引用论文

引用论文

Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge计算机断层扫描图像中自动检测肺结节的算法的验证,比较和组合: LUNA16挑战
err2017-12-01
err762
errOAAI
errSetio, Arnaud Arindra Adiyoso; Traverso, Alberto; de Bel, Thomas; Berens, Moira S. N.; van den Bogaard, Cas; Cerello, Piergiorgio; Chen, Hao; Dou, Qi; Evelina Fantacci, Maria; Geurts, Bram; van der Gugten, Robbert; Heng, Pheng Ann; Jansen, Bart; de Kaste, Michael M. J.; Kotov, Valentin; Lin, Jack Yu-Hung; Manders, Jeroen T. M. C.; Sonora-Mengana, Alexander; Carlos Garcia-Naranjo, Juan; Papavasileiou, Evgenia; Prokop, Mathias; Saletta, Marco; Schaefer-Prokop, Cornelia M.; Scholten, Ernst T.; Scholten, Luuk; Snoeren, Miranda M.; Lopez Torres, Ernesto; Vandemeulebroucke, Jef; Walasek, Nicole; Zuidhof, Guido C. A.; van Ginneken, Bram; Jacobs, Colin
err分享
err收藏
The spectrum of somatic and germline NF1 mutations in NF1 patients with spinal neurofibromas
err2009-02-17
err0
PREAI
errMeena Upadhyaya; Gill Spurlock; Lan Kluwe; Nadia Chuzhanova; Emma Bennett; Nick Thomas; Abhijit Guha; Victor Mautner
err分享
err收藏
Maintenance of Plasma Volume and Serum Sodium Concentration Despite Body Weight Loss in Ironman Triathletes
err2007-03-01
err0
PREAI
errTamara Hew-Butler; Malcolm Collins; Andrew Bosch; Karen Sharwood; Gary Wilson; Miranda Armstrong; Courtney Jennings; Jeroen Swart; Timothy Noakes
err分享
err收藏
学者 查看更多内容