.png){kind=icon}
返回
Downstream-Pretext Domain Knowledge Traceback for Active Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2024.3391897.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Active learning (AL) is designed to construct a high-quality labeled dataset by iteratively selecting the most informative samples. Such sampling heavily relies on data representation, while recently pre-training is popular for robust feature learning. However, as pre-training utilizes low-level pretext tasks that lack annotation, directly using pre-trained representation in AL is inadequate for determining the sampling score. To address this problem, we propose a downstream-pretext domain knowledge traceback (DOKT) method that traces the data interactions of downstream knowledge and pre-training guidance for selecting diverse and instructive samples near the decision boundary. DOKT consists of a traceback diversity indicator and a domain-based uncertainty estimator. The diversity indicator constructs two feature spaces based on the pre-training pretext model and the downstream knowledge from annotation, by which it locates the neighbors of unlabeled data from the downstream space in the pretext space to explore the interaction of samples. With this mechanism, DOKT unifies the data relations of low-level and high-level representations to estimate traceback diversity. Next, in the uncertainty estimator, domain mixing is designed to enforce perceptual perturbing to unlabeled samples with similar visual patches in the pretext space. Then the divergence of perturbed samples is measured to estimate the domain uncertainty. As a result, DOKT selects the most diverse and important samples based on these two modules. The experiments conducted on ten datasets show that our model outperforms other state-of-the-art methods and generalizes well to various application scenarios such as semantic segmentation and image captioning.
Keyword:
Task analysis
Uncertainty
Annotations
Data models
Training
Visualization
Transformers
Active learning
pretext training
domain knowledge
self-supervised learning
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
引用论文
Weak-Labeled Active Learning With Conditional Label Dependence for Multilabel Image Classification基于条件标签依赖的弱标签主动学习多标签图像分类
OAAI
OAAI分享收藏Mechanisms of Disease: local renin–angiotensin–aldosterone systems and the pathogenesis and treatment of cardiovascular disease疾病机制: 局部肾素-血管紧张素-醛固酮系统与心血管疾病的发病机制和治疗
PREAI
分享收藏BACTERIAL INGESTION, TUMOR NECROSIS FACTOR-ALPHA, AND HEAT INDUCE PROGRAMMED CELL DEATH IN ACTIVATED NEUTROPHILS.png)
Shock
ShockIF0
PREAI
分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏
查看更多内容