arrow
Return

Semantic-aware representations for unsupervised Camouflaged Object Detection

delete2025-03-01
delete0
PRE
AI
Z
Zelin Lu
X
Xing Zhao *
L
Liang Xie
H
Haoran Liang
R
Ronghua Liang
DOI:10.1016/j.jvcir.2024.104366delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unsupervised image segmentation algorithms face challenges due to the lack of human annotations. They typically employ representations derived from self-supervised models to generate pseudo-labels for supervising model training. Using this strategy, the model's performance largely depends on the quality of the generated pseudo-labels. In this study, we design an unsupervised framework to perform COD (Camouflaged Object Detection) without the need for generating pseudo-labels. Specifically, we utilize semantic-aware representations, trained in a self-supervised manner on large-scale unlabeled datasets, to guide the training process. These representations not only capturing rich contextual semantic information but also assist in refining the blurred boundaries of camouflaged objects. Furthermore, we design a framework that integrates these semantic- aware representations with task-specific features, enabling the model to perform the UCOD (Unsupervised Camouflaged Object Detection) task with enhanced contextual understanding. Moreover, we introduce an innovative multi-scale token loss function, which maintain the structural integrity of objects at various scales in the model's predictions through mutual supervision between different features and scales. Extensive experimental validation demonstrates that our model significantly enhances the performance of UCOD, closely approaching the capabilities of state-of-the-art weakly-supervised COD models.
Keywords:
Semantic-aware segmentation
Unsupervised object detection
Camouflaged Object Detection

Journal

Journal of Visual Communication and Image Representation cover
Journal of Visual Communication and Image Representation
IF:
3.1
Papers:
414
Citations:
5.6K

Organization

Z
Zhejiang Univ Technol
Scholars:
2.7K
Papers: 978
Citations: 382