arrow
返回

Overcoming Overconfidence for Active Learning

delete2024-01-01
delete0
delete
OA
AI
Y
Yujin Hwang
W
Won Jo
J
Juyoung Hong
Y
Yukyung Choi *
DOI:10.1109/ACCESS.2024.3449915delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent advances in artificial intelligence undeniably depend on vast amounts of high-quality data. However, a persistent global challenge is the restricted budgets allocated for data labeling. To address this, active learning emerges as a prominent and efficient strategy. It involves iterative selections of valuable data for labeling through a model and updating the model based on these selections. Nonetheless, the limited data available in each iteration renders the model susceptible to bias, resulting in potentially overconfident predictions. To mitigate this issue, we propose the Overcoming Overconfidence for Active Learning (OO4AL) framework. This framework comprises two parts: Cross-Mix-and-Mix, an augmentation strategy aimed at broadening the training distribution to calibrate the model, and Ranked Margin Sampling, a selection strategy that prevents the selection of overconfidence-inducing data by evaluating predictions. Through comprehensive experiments and analyses, we demonstrate that our framework facilitates efficient data selection by reducing overconfidence, though it can be readily implemented.
Keyword:
Data models
Uncertainty
Training data
Predictive models
Labeling
Calibration
Image classification
Data integrity
Active learning
model calibration
image classification

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

S
Sejong University
学者数:
8.3K
论文数: 1.1W
被引数: 1.5W
引用论文

引用论文

ACTIVE LEARNING TO OVERCOME SAMPLE SELECTION BIAS: APPLICATION TO PHOTOMETRIC VARIABLE STAR CLASSIFICATION
err2011-12-22
err61
errOAAI
errRichards, Joseph W.; Starr, Dan L.; Brink, Henrik; Miller, Adam A.; Bloom, Joshua S.; Butler, Nathaniel R.; James, J. Berian; Long, James P.; Rice, John
err分享
err收藏
Integrated genetic and epigenetic analysis revealed heterogeneity of acute lymphoblastic leukemia in Down syndrome
err2019-09-10
err0
errOAAI
errYasuo Kubota; Kumiko Uryu; Tatsuya Ito; Masafumi Seki; Tomoko Kawai; Tomoya Isobe; Tadayuki Kumagai; Tsutomu Toki; Kenichi Yoshida; Hiromichi Suzuki; Keisuke Kataoka; Yuichi Shiraishi; Kenichi Chiba; Hiroko Tanaka; Kentaro Ohki; Nobutaka Kiyokawa; Jiro Kagawa; Satoru Miyano; Akira Oka; Yasuhide Hayashi; Seishi Ogawa; Kiminori Terui; Atsushi Sato; Kenichiro Hata; Etsuro Ito; Junko Takita
err分享
err收藏
err分享
err收藏
Investigation on the alkali treatment of Demostachya Bipinnata fibers for automobile applications-A green composite
err2021-01-01
err0
PREAI
errG. Sai Krishnan; J. Pravin Kumar; G. Shanmugasundar; M. Vanitha; N. Sivashanmugam
err分享
err收藏
学者 查看更多内容