arrow
返回

Adversarial Transformers for Weakly Supervised Object Localization

delete2022-01-01
delete4
PRE
AI
M
Meng Meng
张
张天柱 (Tianzhu Zhang) *
Z
Zhe Zhang
张
张勇东 (Yongdong Zhang)
吴
吴枫 (Feng Wu)
DOI:10.1109/TIP.2022.3220055delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Weakly supervised object localization (WSOL) aims at localizing objects with only image-level labels, which has better scalability and practicability than fully supervised methods. However, without pixel-level supervision, existing methods tend to generate rough localization maps, which hinders localization performance. To alleviate this problem, we propose an adversarial transformer network (ATNet), which aims to obtain a well-learned localization model with pixel-level pseudo labels. The proposed ATNet enjoys several merits. First, we design an object transformer ( $G$ ) that can generate localization maps and pseudo labels effectively and dynamically, and a part transformer ( $D$ ) to accurately discriminate detailed local differences between localization maps and pseudo labels. Second, we propose to train $G$ and $D$ via an adversarial process, where $G$ can generate more accurate localization maps approaching pseudo labels to fool $D$ . To the best of our knowledge, this is the first work to explore transformers with adversarial training to obtain a well-learned localization model for WSOL. Extensive experiments with four backbones on two standard benchmarks demonstrate that our ATNet achieves favorable performance against state-of-the-art WSOL methods. Besides, our adversarial training can provide higher robustness against adversarial attacks.
Keyword:
Perturbation methods
Adversarial training
transformers
weakly supervised object localization

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
Chinese Academy of Sciences
学者数:
1.5W
论文数: 4.1K
被引数: 0
引用论文

引用论文

No seasonal variation in human midbrain serotonin transporter availability in Taiwan
err2011-12-01
err0
PREAI
errYu Shian Cheng; Kao Chin Chen; Yen Kuang Yang; Po See Chen; Tzung Lieh Yeh; I Hui Lee; Yun-Hsuan Chang; Mei-Hsiu Liao
err分享
err收藏
Engineering Antibodies with C-Terminal Sortase-Mediated Modification for Targeted Nanomedicine
err2019-07-23
err0
PREAI
errRania A. Hashad; Jaclyn L. Lange; Natasha C. W. Tan; Karen Alt; Christoph E. Hagemeyer
err分享
err收藏
学者 查看更多内容