arrow
返回

Visual Attention Consistency for Human Attribute Recognition

delete2022-03-05
delete10
PRE
AI
H
Hao Guo
X
Xiaochuan Fan
S
Song Wang *
DOI:10.1007/s11263-022-01591-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The recognition of a human attribute is usually determined by certain regions of the input image, e.g., certain part of the human body, and such attribute-region relevance plays an important role in human attribute recognition. In deep networks, this attribute-region relevance can be derived as an interpretive attention map, where highlighted areas indicate the most relevant regions that contribute to the final recognition. Based on the assumption that more plausible attention maps indicate better networks, in this paper, we propose a new approach for human attribute recognition by exploring and enforcing two kinds of attention consistency in network learning. One kind of consistency enforces the equivariance of the attention map when the input image undergoes certain spatial transforms, such as scaling, rotation and flipping. The other kind of the consistency is enforced between the attention maps derived from two different networks when both of them are trained for recognizing the same attribute from the same image. We formulate these two kinds of consistency as new loss functions and combine them with the traditional classification loss for network training. Experiments on three datasets of human attribute recognition verify the effectiveness of the proposed method by achieving new state-of-the-art performance.
Keyword:
Attention maps
Human attribute recognition
Attention consistency
Equivariance

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

U
university of south carolina columbia
学者数:
9.6K
论文数: 8.5K
被引数: 7
U
University of South Carolina System
学者数:
1.5W
论文数: 1.4W
被引数: 27
引用论文

引用论文

err分享
err收藏
Tocilizumab treatment in childhood Takayasu arteritis: Case series of four patients and systematic review of the literature
err2017-02-01
err0
PREAI
errEzgi Deniz Batu; Hafize Emine Sönmez; Tuncay Hazırolan; Fatih Özaltın; Yelda Bilginer; Seza Özen
err分享
err收藏
More tricks with tetramers: a practical guide to staining T cells with peptide–MHC multimers
err2015-08-04
err0
errOAAI
errGarry Dolton; Katie Tungatt; Angharad Lloyd; Valentina Bianchi; Sarah M. Theaker; Andrew Trimby; Christopher J. Holland; Marco Donia; Andrew J. Godkin; David K. Cole; Per Thor Straten; Mark Peakman; Inge Marie Svane; Andrew K. Sewell
err分享
err收藏
err分享
err收藏
Significance of nailfold videocapillaroscopy in patients with idiopathic inflammatory myopathies
err2018-08-28
err0
errOAAI
errSatoshi Kubo; Yasuyuki Todoroki; Shingo Nakayamada; Kazuhisa Nakano; Minoru Satoh; Aya Nawata; Yurie Satoh; Ippei Miyagawa; Kazuyoshi Saito; Vanessa Smith; Maurizio Cutolo; Yoshiya Tanaka
err分享
err收藏
学者 查看更多内容