arrow
Return

LayerCAM: Exploring Hierarchical Class Activation Maps for Localization

delete2021-01-01
delete369
PRE
AI
P
Peng-Tao Jiang
C
Chang–Bin Zhang
Q
Qibin Hou
M
Ming‐Ming Cheng *
Y
Yunchao Wei
DOI:10.1109/TIP.2021.3089943delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The class activation maps are generated from the final convolutional layer of CNN. They can highlight discriminative object regions for the class of interest. These discovered object regions have been widely used for weakly-supervised tasks. However, due to the small spatial resolution of the final convolutional layer, such class activation maps often locate coarse regions of the target objects, limiting the performance of weakly-supervised tasks that need pixel-accurate object locations. Thus, we aim to generate more fine-grained object localization information from the class activation maps to locate the target objects more accurately. In this paper, by rethinking the relationships between the feature maps and their corresponding gradients, we propose a simple yet effective method, called LayerCAM. It can produce reliable class activation maps for different layers of CNN. This property enables us to collect object localization information from coarse (rough spatial localization) to fine (precise fine-grained details) levels. We further integrate them into a high-quality class activation map, where the object-related pixels can be better highlighted. To evaluate the quality of the class activation maps produced by LayerCAM, we apply them to weakly-supervised object localization and semantic segmentation. Experiments demonstrate that the class activation maps generated by our method are more effective and reliable than those by the existing attention methods. The code will be made publicly available.
Keywords:
Location awareness
Task analysis
Semantics
Image segmentation
Reliability
Convolution
Spatial resolution
Weakly-supervised object localization
class activation maps
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

B
Beijing Jiaotong University
Scholars:
2.2W
Papers: 1.7W
Citations: 1.2W
N
National University of Singapore
Scholars:
7.5W
Papers: 6.4W
Citations: 11.4W
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74
researcher View more organizations