arrow
返回

Active Learning With Long-Range Observation

delete2024-01-01
delete0
PRE
AI
J
Jiho Lee
E
Eunwoo Kim *
DOI:10.1109/LSP.2024.3435417delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the era of data-driven technological advancements, deep learning still craves more training data. However, the high cost of data annotation and limited budgets pose significant challenges. To address this issue, active learning (AL) has emerged, and it gradually adds some informative samples to the training data by querying humans for annotation. Existing works have mainly focused on how to sample useful data based on the estimations of the model in the current cycle (time). However, models in different cycles have distinct knowledge and biases by training with the expanding dataset. Also, relying solely on a present bias is not necessarily the best choice in the real world, where the knowledge of the present model is distorted by labeling attacks or mislabeling situations. Here, we propose a novel AL approach that expands viewpoint and knowledge with the strong committee having long-range observation for seeking informative data. The committee is designed to reflect estimations of all previous and current models and sample data points by selectively aggregating model estimations. By exploiting various trajectories of multiple models and broadening knowledge, it can overcome limited perspectives and potential shortcomings of the current estimation. We validate the proposed approach under ideal and realistic scenarios with coarse-grained and fined-grained image classification tasks. In experimental results, the proposed method outperforms recent competitive methods for six settings, including realistic and ideal scenarios.
Keyword:
Estimation
Training
Training data
Data models
Annotations
Uncertainty
Loss measurement
Active learning
long-range observation

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

C
Chung Ang University
学者数:
1.3W
论文数: 1.4W
被引数: 133
引用论文

引用论文

Integrated genetic and epigenetic analysis revealed heterogeneity of acute lymphoblastic leukemia in Down syndrome
err2019-09-10
err0
errOAAI
errYasuo Kubota; Kumiko Uryu; Tatsuya Ito; Masafumi Seki; Tomoko Kawai; Tomoya Isobe; Tadayuki Kumagai; Tsutomu Toki; Kenichi Yoshida; Hiromichi Suzuki; Keisuke Kataoka; Yuichi Shiraishi; Kenichi Chiba; Hiroko Tanaka; Kentaro Ohki; Nobutaka Kiyokawa; Jiro Kagawa; Satoru Miyano; Akira Oka; Yasuhide Hayashi; Seishi Ogawa; Kiminori Terui; Atsushi Sato; Kenichiro Hata; Etsuro Ito; Junko Takita
err分享
err收藏
err分享
err收藏
err分享
err收藏
Improving the hepatitis cascade: assessing hepatitis testing and its management in primary health care in China
err2018-05-08
err0
errOAAI
errWilliam C W Wong; Ying-Ru Lo; Sunfang Jiang; Minghui Peng; Shanzhu Zhu; Michael R Kidd; Xia-Chun Wang; Po-Lin Chan; Jason J Ong
err分享
err收藏
Elan: Towards Generic and Efficient Elastic Training for Deep Learning
err2020-11-01
err0
PREAI
errLei Xie; Jidong Zhai; Baodong Wu; Yuanbo Wang; Xingcheng Zhang; Peng Sun; Shengen Yan
err分享
err收藏
学者 查看更多内容