.png){kind=icon}
返回
Weakly-Supervised Contrastive Learning for Unsupervised Object Discovery
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2024.3380243.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Unsupervised object discovery (UOD) refers to the task of discriminating the whole region of objects from the background within a scene without relying on labeled datasets, which benefits the task of bounding-box-level localization and pixel-level segmentation. This task is promising due to its ability to discover objects in a generic manner. We roughly categorize existing techniques into two main directions, namely the generative solutions based on image resynthesis, and the clustering methods based on self-supervised models. We have observed that the former heavily relies on the quality of image reconstruction, while the latter shows limitations in effectively modeling semantic correlations. To directly target at object discovery, we focus on the latter approach and propose a novel solution by incorporating weakly-supervised contrastive learning (WCL) to enhance semantic information exploration. We design a semantic-guided self-supervised learning model to extract high-level semantic features from images, which is achieved by fine-tuning the feature encoder of a self-supervised model, namely DINO, via WCL. Subsequently, we introduce Principal Component Analysis (PCA) to localize object regions. The principal projection direction, corresponding to the maximal eigenvalue, serves as an indicator of the object region(s). Extensive experiments on benchmark unsupervised object discovery datasets demonstrate the effectiveness of our proposed solution. The source code and experimental results are publicly available via our project page at https://github.com/npucvr/WSCUOD.git.
Keyword:
Self-supervised learning
Semantics
Task analysis
Representation learning
Principal component analysis
Feature extraction
Image segmentation
Unsupervised object discovery
weakly-supervised contrastive learning
principal component analysis
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
LID, LEED, and Alternative Rating Systems—Integrating Low Impact Development Techniques with Green Building DesignLID，LEED和替代评级系统-将低影响开发技术与绿色建筑设计相结合
PREAI
分享收藏Innovation, creativity and governance: Social dynamics of economic performance in city-regions.png)
Innovation
InnovationIF0
PREAI
分享收藏
Tinnitus Retraining Therapy (TRT) as a Method for Treatment of Tinnitus and Hyperacusis Patients耳鸣再训练疗法 (TRT) 作为治疗耳鸣和高亢患者的方法
PREAI
分享收藏
查看更多内容