arrow
返回

SPA2Net: Structure-Preserved Attention Activated Network for Weakly Supervised Object Localization

delete2023-01-01
delete1
PRE
AI
D
Dong Chen
X
Xingjia Pan
唐
唐帆 (Fan Tang) *
董未名 封面图
董未名 (Weiming Dong)
徐
徐常胜 (Changsheng Xu)
DOI:10.1109/TIP.2023.3323793delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
By exploring the localizable representations in deep CNN, weakly supervised object localization (WSOL) methods could determine the position of the object in each image just trained by the classification task. However, the partial activation problem caused by the discriminant function makes the network unable to locate objects accurately. To alleviate this problem, we propose Structure-Preserved Attention Activated Network (SPA(2)Net), a simple and effective one-stage WSOL framework to explore the ability of structure preservation of deep features. Different from traditional WSOL approaches, we decouple the object localization task from the classification branch to reduce their mutual influence by involving a localization branch which is online refined by a self-supervised structural-preserved localization mask. Specifically, we employ the high-order self-correlation as structural prior to enhance the perception of spatial interaction within convolutional features. By succinctly combining the structural prior with spatial attention, activations by SPA(2)Net will spread from part to the whole object during training. To avoid the structure-missing issue caused by the classification network, we furthermore utilize the restricted activation loss (RAL) to distinguish the difference between foreground and background in the channel dimension. In conjunction with the self-supervised localization branch, SPA(2)Net can directly predict the class-irrelevant localization map while prompting the network to pay more attention to the target region for accurate localization. Extensive experiments on two publicly available benchmarks, including CUB-200-2011 and ILSVRC, show that our SPA(2)Net achieves substantial and consistent performance gains compared with baseline approaches. The code and models are available at https://github.com/MsterDC/SPA2Net.
Keyword:
High-order self-correlation
class activation map
structure preservation
weakly supervised object localization

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

I
institute of computing technology, cas
学者数:
1.0K
论文数: 878
被引数: 1
J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Intra-Abdominal Splenosis Mimicking Metastatic Cancer
err2011-03-01
err0
PREAI
errNicholas J. Short; Teresa G. Hayes; Peeyush Bhargava
err分享
err收藏
Transformers in computational visual media: A survey
err2022-03-01
err85
errOAAI
errXu, Yifan; Wei, Huapeng; Lin, Minxuan; Deng, Yingying; Sheng, Kekai; Zhang, Mengdan; Tang, Fan; Dong, Weiming; Huang, Feiyue; Xu, Changsheng
err分享
err收藏
err分享
err收藏
Stability of adaptive behaviors in middle-school children with autism spectrum disorders
err2007-10-01
err0
PREAI
errRobin L. Gabriels; Bonnie Jean Ivers; Dina E. Hill; John A. Agnew; John McNeill
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容