arrow
Return

DMAP: Decoupling-Driven Multi-Level Attribute Parsing for Interpretable Outfit Collocation

delete2024-01-01
delete0
PRE
AI
Z
Zhuo Su
Y
Yilin Chen
F
Fuwei Zhang
R
Ruomei Wang
F
Fan Zhou
Ge LIN cover
Ge LIN (Ge Lin) *
DOI:10.1109/TMM.2024.3402541delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Outfit collocation requires considering the interrelationship and adaptability among the attributes of component items. However, with the numerous and diverse attributes of fashion items, accurately capturing attribute features and modeling the complex relationships between attributes become the key challenges. To address these challenges, we propose a novel scheme Decoupling-driven Multi-level Attribute Parsing for interpretable outfit collocation. First, we decouple a series of attribute features from the item's visual feature by fully supervised, which can improve the robustness of the model in processing both relevant and irrelevant attributes of items. Furthermore, employing a deep deconvolution neural network with attention mechanisms to reconstruct the decoupled attribute features into a visual image that is close to the original item image. It ensures all attribute features can be combined to contain complete item information. Next, graph attention networks are constructed to parse multi-level attribute compatibility relationships from three perspectives: intra-attribute, inter-attribute, and item integration relationships. Finally, we use multi-layer perceptrons to fuse the score distributions of the three and output the outfit compatibility score. Experiments conducted on the IQON3000 dataset demonstrate that our model outperforms existing state-of-the-art methods and exhibits good interpretability.
Keywords:
Visualization
Feature extraction
Image reconstruction
Image color analysis
Deconvolution
Cotton
Matrix decomposition
Attribute parsing
graph attention network
image reconstruction
interpretability

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

N
North University of China
Scholars:
1.1W
Papers: 6.9K
Citations: 7.7K
S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
Cited Papers

Cited Papers

Can CD34 discriminate between benign and malignant hepatocytic lesions in fine-needle aspirates and thin core biopsies?
err2000-11-10
err0
errOAAI
errW. Bastiaan de Boer; Amanda Segal; Felicity A. Frost; Gregory F. Sterrett
errShare
errSave
A3-FKG: Attentive Attribute-Aware Fashion Knowledge Graph for Outfit Preference Prediction
err2022-01-01
err30
PREAI
errZhan, Huijing; Lin, Jie; Ak, Kenan Emir; Shi, Boxin; Duan, Ling-Yu; Kot, Alex C.
errShare
errSave
Alpha-1-antitrypsin: New perspectives and clinical applications
err1990-07-01
err0
PREAI
errRoger S. Riley; John R. Forney; Charles A. Bradley; Dale D. Dunn
errShare
errSave
A Technique for Measuring Petal Gloss, with Examples from the Namaqualand Flora
err2012-01-10
err0
errOAAI
errHeather M. Whitney; Sean A. Rands; Nick J. Elton; Allan G. Ellis
errShare
errSave
Attribute-wise Explainable Fashion Compatibility Modeling
err2021-04-16
err20
PREAI
errYang, Xin; Song, Xuemeng; Feng, Fuli; Wen, Haokun; Duan, Ling-Yu; Nie, Liqiang
errShare
errSave
errShare
errSave
Collagen–elastin ratio predicts burst pressure of arterial seals created using a bipolar vessel sealing device in a porcine model
err2011-03-15
err0
PREAI
errDavid Sindram; Kimberly Martin; Jarrod P. Meadows; Ajita S. Prabhu; Jessica J. Heath; Iain H. McKillop; David A. Iannitti
errShare
errSave
errShare
errSave
researcher View more