.png){kind=icon}
Return
Token-Level Contrastive Learning for Open-World Weakly-Supervised Object Localization
.png){kind=icon}
PRE
AI
DOI：10.1007/978-981-95-5755-4_22.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Open-World Weakly-Supervised Object Localization (OWSOL) targets the recognition and localization of both known and novel categories in open-world situations. The pioneering work primarily tackles the problem by proposing a generalized representation learning paradigm, which lacks targeted optimization for Vision Transformers (ViT). We argue that long-range visual dependencies of ViT are specialized in complete perception of objects. To better adapt ViT into OWSOL, in this work, we propose a Token-level Contrastive Learning (ToCL) framework. It mainly contains supervised contrastive learning on labeled data and, semantics-driven token-level contrastive learning on labeled and unlabeled ones. Specifically, contrastive learning is performed on both class and patch tokens, which learns complementarily for fine-grained semantics. Besides, tokens of foreground and background are learned to distribute apart by contrast. The above operations potentially enable self-attentions of ViT to accurately and completely focus on the target object regions. Extensive experiments on ImageNet-1K, iNatLoc500, and OpenImages150 datasets show that our method outperforms the state-of-the-art methods by a large margin. Code will be released.
Keywords:
Open-World Weakly-Supervised Object Localization
Vision Transformer
Token-level Contrastive Learning
Generalized Representation Learning
Self-Attention
Journal
P
IF:
0
Papers:
27
Citations:
0
Organization
Cited Papers
.png){kind=icon}
ShareSave
Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentation
OAAI
OAAIShareSaveShareSaveShareSaveShareSave
View more