arrow
Return

Visual Attention Consistency for Human Attribute Recognition

delete2022-03-05
delete10
PRE
AI
H
Hao Guo
X
Xiaochuan Fan
Song Wang cover
Song Wang (Song Wang) *
DOI:10.1007/s11263-022-01591-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The recognition of a human attribute is usually determined by certain regions of the input image, e.g., certain part of the human body, and such attribute-region relevance plays an important role in human attribute recognition. In deep networks, this attribute-region relevance can be derived as an interpretive attention map, where highlighted areas indicate the most relevant regions that contribute to the final recognition. Based on the assumption that more plausible attention maps indicate better networks, in this paper, we propose a new approach for human attribute recognition by exploring and enforcing two kinds of attention consistency in network learning. One kind of consistency enforces the equivariance of the attention map when the input image undergoes certain spatial transforms, such as scaling, rotation and flipping. The other kind of the consistency is enforced between the attention maps derived from two different networks when both of them are trained for recognizing the same attribute from the same image. We formulate these two kinds of consistency as new loss functions and combine them with the traditional classification loss for network training. Experiments on three datasets of human attribute recognition verify the effectiveness of the proposed method by achieving new state-of-the-art performance.
Keywords:
Attention maps
Human attribute recognition
Attention consistency
Equivariance

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

U
university of south carolina columbia
Scholars:
9.6K
Papers: 8.5K
Citations: 7
U
University of South Carolina System
Scholars:
1.6W
Papers: 1.5W
Citations: 27
Cited Papers

Cited Papers

Configuration of physical distribution networks
err2006-10-11
err0
PREAI
errCarlos F. Daganzo; Gordon F. Newell
errShare
errSave
errShare
errSave
Tocilizumab treatment in childhood Takayasu arteritis: Case series of four patients and systematic review of the literature
err2017-02-01
err0
PREAI
errEzgi Deniz Batu; Hafize Emine Sönmez; Tuncay Hazırolan; Fatih Özaltın; Yelda Bilginer; Seza Özen
errShare
errSave
More tricks with tetramers: a practical guide to staining T cells with peptide–MHC multimers
err2015-08-04
err0
errOAAI
errGarry Dolton; Katie Tungatt; Angharad Lloyd; Valentina Bianchi; Sarah M. Theaker; Andrew Trimby; Christopher J. Holland; Marco Donia; Andrew J. Godkin; David K. Cole; Per Thor Straten; Mark Peakman; Inge Marie Svane; Andrew K. Sewell
errShare
errSave
errShare
errSave
Significance of nailfold videocapillaroscopy in patients with idiopathic inflammatory myopathies
err2018-08-28
err0
errOAAI
errSatoshi Kubo; Yasuyuki Todoroki; Shingo Nakayamada; Kazuhisa Nakano; Minoru Satoh; Aya Nawata; Yurie Satoh; Ippei Miyagawa; Kazuyoshi Saito; Vanessa Smith; Maurizio Cutolo; Yoshiya Tanaka
errShare
errSave
researcher View more