arrow
Return

Multi-Task CNN Model for Attribute Prediction

delete2015-11-01
delete221
delete
OA
AI
A
Abdulnabi, Abrar H. *
W
Wang, Gang
J
Jiwen Lu
J
Jia, Kui
DOI:10.1109/TMM.2015.2477680delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN will predict one binary attribute. The multi-task learning allows CNN models to simultaneously share visual knowledge among different attribute categories. Each CNN will generate attribute-specific feature representations, and then we apply multi-task learning on the features to predict their attributes. In our multi-task framework, we propose a method to decompose the overall model's parameters into a latent task matrix and combination matrix. Furthermore, under-sampled classifiers can leverage shared statistics from other classifiers to improve their performance. Natural grouping of attributes is applied such that attributes in the same group are encouraged to share more knowledge. Meanwhile, attributes in different groups will generally compete with each other, and consequently share less knowledge. We show the effectiveness of our method on two popular attribute datasets.
Keywords:
Deep CNN
latent tasks matrix
multi-task learning
semantic attributes

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
U
University of Macau
Scholars:
1.1W
Papers: 1.3W
Citations: 2.0W
researcher View more organizations
Cited Papers

Cited Papers

Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
errShare
errSave
Loss of hippocampal [3H]TCP binding in Alzheimer's disease
err1987-03-01
err0
errOAAI
errWilliam F. Maragos; Dorothy C.M. Chu; Anne B. Young; Constance J. D'Amato; John B. Penney
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Olfactory neuron-specific expression of NeuroD in mouse and human nasal mucosa
err1999-11-29
err0
PREAI
errKen-ichi Nibu; Guoqi Li; Xunling Zhang; Nancy E. Rawson; Diego Restrepo; Kimitaka Kaga; Louis D. Lowry; William M. Keane; Jay L. Rothstein
errShare
errSave
researcher View more