arrow
Return

Active Learning With Long-Range Observation

delete2024-01-01
delete0
PRE
AI
J
Jiho Lee
E
Eunwoo Kim *
DOI:10.1109/LSP.2024.3435417delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the era of data-driven technological advancements, deep learning still craves more training data. However, the high cost of data annotation and limited budgets pose significant challenges. To address this issue, active learning (AL) has emerged, and it gradually adds some informative samples to the training data by querying humans for annotation. Existing works have mainly focused on how to sample useful data based on the estimations of the model in the current cycle (time). However, models in different cycles have distinct knowledge and biases by training with the expanding dataset. Also, relying solely on a present bias is not necessarily the best choice in the real world, where the knowledge of the present model is distorted by labeling attacks or mislabeling situations. Here, we propose a novel AL approach that expands viewpoint and knowledge with the strong committee having long-range observation for seeking informative data. The committee is designed to reflect estimations of all previous and current models and sample data points by selectively aggregating model estimations. By exploiting various trajectories of multiple models and broadening knowledge, it can overcome limited perspectives and potential shortcomings of the current estimation. We validate the proposed approach under ideal and realistic scenarios with coarse-grained and fined-grained image classification tasks. In experimental results, the proposed method outperforms recent competitive methods for six settings, including realistic and ideal scenarios.
Keywords:
Estimation
Training
Training data
Data models
Annotations
Uncertainty
Loss measurement
Active learning
long-range observation

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

C
Chung Ang University
Scholars:
1.3W
Papers: 1.4W
Citations: 133
Cited Papers

Cited Papers

Integrated genetic and epigenetic analysis revealed heterogeneity of acute lymphoblastic leukemia in Down syndrome
err2019-09-10
err0
errOAAI
errYasuo Kubota; Kumiko Uryu; Tatsuya Ito; Masafumi Seki; Tomoko Kawai; Tomoya Isobe; Tadayuki Kumagai; Tsutomu Toki; Kenichi Yoshida; Hiromichi Suzuki; Keisuke Kataoka; Yuichi Shiraishi; Kenichi Chiba; Hiroko Tanaka; Kentaro Ohki; Nobutaka Kiyokawa; Jiro Kagawa; Satoru Miyano; Akira Oka; Yasuhide Hayashi; Seishi Ogawa; Kiminori Terui; Atsushi Sato; Kenichiro Hata; Etsuro Ito; Junko Takita
errShare
errSave
errShare
errSave
errShare
errSave
Improving the hepatitis cascade: assessing hepatitis testing and its management in primary health care in China
err2018-05-08
err0
errOAAI
errWilliam C W Wong; Ying-Ru Lo; Sunfang Jiang; Minghui Peng; Shanzhu Zhu; Michael R Kidd; Xia-Chun Wang; Po-Lin Chan; Jason J Ong
errShare
errSave
A recipe for sintering submicron silver powders
err1984-05-01
err0
PREAI
errV. Keith; M.G. Ward
errShare
errSave
Breath Acetone-Based Non-Invasive Detection of Blood Glucose Levels
err2015-06-01
err0
errOAAI
errAnand Thati; Arunangshu Biswas; Shubhajit Roy Chowdhury; Tapan Kumar Sau
errShare
errSave
Elan: Towards Generic and Efficient Elastic Training for Deep Learning
err2020-11-01
err0
PREAI
errLei Xie; Jidong Zhai; Baodong Wu; Yuanbo Wang; Xingcheng Zhang; Peng Sun; Shengen Yan
errShare
errSave
researcher View more