返回
Active Learning With Long-Range Observation
DOI:10.1109/LSP.2024.3435417.png)
摘要
En 中文
In the era of data-driven technological advancements, deep learning still craves more training data. However, the high cost of data annotation and limited budgets pose significant challenges. To address this issue, active learning (AL) has emerged, and it gradually adds some informative samples to the training data by querying humans for annotation. Existing works have mainly focused on how to sample useful data based on the estimations of the model in the current cycle (time). However, models in different cycles have distinct knowledge and biases by training with the expanding dataset. Also, relying solely on a present bias is not necessarily the best choice in the real world, where the knowledge of the present model is distorted by labeling attacks or mislabeling situations. Here, we propose a novel AL approach that expands viewpoint and knowledge with the strong committee having long-range observation for seeking informative data. The committee is designed to reflect estimations of all previous and current models and sample data points by selectively aggregating model estimations. By exploiting various trajectories of multiple models and broadening knowledge, it can overcome limited perspectives and potential shortcomings of the current estimation. We validate the proposed approach under ideal and realistic scenarios with coarse-grained and fined-grained image classification tasks. In experimental results, the proposed method outperforms recent competitive methods for six settings, including realistic and ideal scenarios.
Keyword:
Estimation
Training
Training data
Data models
Annotations
Uncertainty
Loss measurement
Active learning
long-range observation
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
A study of the effect of different types of noise on the precision of supervised learning techniques
Mechanisms of Disease: local renin–angiotensin–aldosterone systems and the pathogenesis and treatment of cardiovascular disease疾病机制: 局部肾素-血管紧张素-醛固酮系统与心血管疾病的发病机制和治疗

