Scale-aware attention network for weakly supervised semantic segmentation

doi:10.1016/j.neucom.2022.04.006

2022-07-01

PRE

DOI：10.1016/j.neucom.2022.04.006

原文链接

原文求助

摘要

En 中文

Weakly supervised semantic segmentation (WSSS) using image-level labels greatly alleviates the burden of obtaining large amounts of pixel-wise annotations. To create pseudo segmentation labels, most WSSS algorithms rely on the local response regions in the class activation maps (CAMs). However, such activa-tion maps only focus on the local discriminative parts of the object, because the classification network does not require the entire object to optimize the objective function. To enhance the network's ability to focus more on non-discriminative parts of the object and generate high-quality pseudo-masks, the Scale-aware Attention Network (SAN) is proposed. Specifically, a pyramidal attention module is intro-duced to propagate discriminative information to adjacent object regions by adaptively selecting contex-tual features from the convolutional pyramid with varied filter scales. A multi-scale prediction fusion structure with a joint loss is proposed to make better use of the complementary information of localiza-tion maps in different scales. The dense and integral localization maps are obtained in the inference stage by weighted fusion of the multi-scale predictions, which are then used to train segmentation models. This novel SAN has demonstrated its effectiveness in a series of experiments. It has achieved a state-of-the-art result of 71.9% mIoU on the PASCAL VOC 2012 segmentation test set compared with other approaches under the same level of supervision.(c) 2022 Elsevier B.V. All rights reserved.

Keyword:

Weakly supervised semantic segmentation

Class activation map

Multi-scale feature

Attention mechanism