arrow
Return

Multi-Layer Decoupling Attention Network for Weakly Supervised Object Localization

delete2024-01-01
delete0
PRE
AI
Z
Zhang, Aoran
凌志刚 cover
凌志刚 (Zhigang Ling) *
王耀南 cover
王耀南 (Yaonan Wang)
DOI:10.1109/TMM.2023.3323860delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Weakly supervised object localization (WSOL) aims to localize the entire and well-defined objects only via image-level labels for reducing the need of labor-intensive annotation and mitigating annotation errors. However, many WSOL methods via class activation maps (CAMs) often suffer from incomplete activation and inaccurate boundaries for object localization. In this article, we propose a novel multi-layer decoupling attention localization (MDAL) network to address these issues. We first present a simple yet effective multi-layer comparison decoupling mechanism including a maximum decoupling function and a minimum decoupling function to sufficiently activate and fuse multi-layer features. Then, we introduce the multi-layer maximum decoupling function into the attention modules, and develop a channel attention activation decoupling (CAAD) module and a spatial attention activation decoupling (SAAD) module, which can mine much more useful information for more possible regions' activation. Furthermore, the multi-layer minimum decoupling function is introduced to efficiently fuse and refine multi-layer features, which can suppress the over-activation and background noise. Finally, we develop a joint loss function to train the MDAL network. Experimental results on CUB-200-2011 and ILSVRC2012 demonstrate that our proposed network can provide accurate and complete object localization.
Keywords:
Location awareness
Cams
Annotations
Visualization
Fuses
Background noise
Semantics
Multi-layer comparison decoupling mechanism
multi-layer minimum decoupling feature fusion
channel attention activation decoupling (CAAD)
spatial attention activation decoupling (SAAD)
weakly supervised object localization

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

H
hunan university
Scholars:
4.5W
Papers: 3.3W
Citations: 70
Cited Papers

Cited Papers

Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
errShare
errSave
The kinetics of carbon clustering in martensite
err1978-06-01
err0
PREAI
errNicholas DeCristofaro; Roy Kaplow; Walter S. Owen
errShare
errSave
Top-Down Neural Attention by Excitation Backprop
err2017-12-23
err413
PREAI
errZhang, Jianming; Bargal, Sarah Adel; Lin, Zhe; Brandt, Jonathan; Shen, Xiaohui; Sclaroff, Stan
errShare
errSave
Further Developments in Rapidly Decelerating Turbulent Pipe Flow Modeling
err2014-07-01
err0
errOAAI
errS. Meniconi; H. F. Duan; B. Brunone; M. S. Ghidaoui; P. J. Lee; M. Ferrante
errShare
errSave
Magnetic lower esophageal sphincter augmentation device removal
err2014-08-14
err0
PREAI
errCristina R. Harnsberger; Ryan C. Broderick; Hans F. Fuchs; Martin Berducci; Catherine Beck; Alberto Gallo; Garth R. Jacobsen; Bryan J. Sandler; Santiago Horgan
errShare
errSave
Stability of adaptive behaviors in middle-school children with autism spectrum disorders
err2007-10-01
err0
PREAI
errRobin L. Gabriels; Bonnie Jean Ivers; Dina E. Hill; John A. Agnew; John McNeill
errShare
errSave
researcher View more