返回
Learning to Detect Instance-Level Salient Objects Using Complementary Image Labels
DOI:10.1007/s11263-021-01553-w.png)
摘要
En 中文
Existing salient instance detection (SID) methods typically learn from pixel-level annotated datasets. In this paper, we present the first weakly-supervised approach to the SID problem. Although weak supervision has been considered in general saliency detection, it is mainly based on using class labels for object localization. However, it is non-trivial to use only class labels to learn instance-aware saliency information, as salient instances with high semantic affinities may not be easily separated by the labels. As the subitizing information provides an instant judgement on the number of salient items, it is naturally related to detecting salient instances and may help separate instances of the same class while grouping different parts of the same instance. Inspired by this observation, we propose to use class and subitizing labels as weak supervision for the SID problem. We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids. This complementary information is then fused to produce a salient instance map. To facilitate the learning process, we further propose a progressive training scheme to reduce label noise and the corresponding noise learned by the model, via reciprocating the model with progressive salient instance prediction and model refreshing. Our extensive evaluations show that the proposed method plays favorably against carefully designed baseline methods adapted from related tasks.
Keyword:
SID
Weak supervision
Saliency detection
Subitizing
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
LID, LEED, and Alternative Rating Systems—Integrating Low Impact Development Techniques with Green Building DesignLID,LEED和替代评级系统-将低影响开发技术与绿色建筑设计相结合
Distribution, Source Identification, and Assessment of Potentially Toxic Elements in the Sediment Core from the Estuarine Region of the Golmud River to the Qarhan Salt Lake, Qinghai, China
Minerals
IF0
Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时,热舒适性,感知的空气质量和认知表现
Indoor Air
IF0
The food water energy nexus in an urban context: Connecting theory and practice for nexus governance

