arrow
返回

Learning to Detect Instance-Level Salient Objects Using Complementary Image Labels

delete2022-01-31
delete16
PRE
AI
X
Xin Tian *
K
Ke Xu
X
Xin Yang
B
Baocai Yin
R
Rynson W. H. Lau
DOI:10.1007/s11263-021-01553-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing salient instance detection (SID) methods typically learn from pixel-level annotated datasets. In this paper, we present the first weakly-supervised approach to the SID problem. Although weak supervision has been considered in general saliency detection, it is mainly based on using class labels for object localization. However, it is non-trivial to use only class labels to learn instance-aware saliency information, as salient instances with high semantic affinities may not be easily separated by the labels. As the subitizing information provides an instant judgement on the number of salient items, it is naturally related to detecting salient instances and may help separate instances of the same class while grouping different parts of the same instance. Inspired by this observation, we propose to use class and subitizing labels as weak supervision for the SID problem. We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids. This complementary information is then fused to produce a salient instance map. To facilitate the learning process, we further propose a progressive training scheme to reduce label noise and the corresponding noise learned by the model, via reciprocating the model with progressive salient instance prediction and model refreshing. Our extensive evaluations show that the proposed method plays favorably against carefully designed baseline methods adapted from related tasks.
Keyword:
SID
Weak supervision
Saliency detection
Subitizing

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

C
City University of Hong Kong
学者数:
2.3W
论文数: 3.0W
被引数: 6.1W
D
Dalian University of Technology
学者数:
5.9W
论文数: 4.4W
被引数: 5.5W
引用论文

引用论文

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Pituitary Apoplexy and Its Effect on Vision
err1991-11-01
err0
PREAI
errRobert M. McFadzean; David Doyle; Roy Rampling; Evelyn Teasdale; Graham Teasdale
err分享
err收藏
The food water energy nexus in an urban context: Connecting theory and practice for nexus governance
err2022-04-01
err0
errOAAI
errMari R. Tye; Olga V. Wilhelmi; Andrea L. Pierce; Saloni Sharma; Iuliana Nichersu; Michał Wróblewski; Wojciech Goszczyński; Jochen Wendel; Pia Laborgne; Monika Heyder; Iulian Nichersu
err分享
err收藏
学者 查看更多内容