arrow
Return

Scale-aware attention network for weakly supervised semantic segmentation

delete2022-07-01
delete7
PRE
AI
Z
Zhiyuan Cao
Y
Yufei Gao
张家才 (Jiacai Zhang) *
DOI:10.1016/j.neucom.2022.04.006delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Weakly supervised semantic segmentation (WSSS) using image-level labels greatly alleviates the burden of obtaining large amounts of pixel-wise annotations. To create pseudo segmentation labels, most WSSS algorithms rely on the local response regions in the class activation maps (CAMs). However, such activa-tion maps only focus on the local discriminative parts of the object, because the classification network does not require the entire object to optimize the objective function. To enhance the network's ability to focus more on non-discriminative parts of the object and generate high-quality pseudo-masks, the Scale-aware Attention Network (SAN) is proposed. Specifically, a pyramidal attention module is intro-duced to propagate discriminative information to adjacent object regions by adaptively selecting contex-tual features from the convolutional pyramid with varied filter scales. A multi-scale prediction fusion structure with a joint loss is proposed to make better use of the complementary information of localiza-tion maps in different scales. The dense and integral localization maps are obtained in the inference stage by weighted fusion of the multi-scale predictions, which are then used to train segmentation models. This novel SAN has demonstrated its effectiveness in a series of experiments. It has achieved a state-of-the-art result of 71.9% mIoU on the PASCAL VOC 2012 segmentation test set compared with other approaches under the same level of supervision.(c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Weakly supervised semantic segmentation
Class activation map
Multi-scale feature
Attention mechanism

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
Beijing Normal University
Scholars:
3.3W
Papers: 2.7W
Citations: 4.2W
Z
Zhengzhou University
Scholars:
6.8W
Papers: 4.4W
Citations: 8.5W