arrow
返回

DMAP: Decoupling-Driven Multi-Level Attribute Parsing for Interpretable Outfit Collocation

delete2024-01-01
delete0
PRE
AI
Z
Zhuo Su
Y
Yilin Chen
F
Fuwei Zhang
R
Ruomei Wang
F
Fan Zhou
Ge LIN 封面图
Ge LIN (Ge Lin) *
DOI:10.1109/TMM.2024.3402541delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Outfit collocation requires considering the interrelationship and adaptability among the attributes of component items. However, with the numerous and diverse attributes of fashion items, accurately capturing attribute features and modeling the complex relationships between attributes become the key challenges. To address these challenges, we propose a novel scheme Decoupling-driven Multi-level Attribute Parsing for interpretable outfit collocation. First, we decouple a series of attribute features from the item's visual feature by fully supervised, which can improve the robustness of the model in processing both relevant and irrelevant attributes of items. Furthermore, employing a deep deconvolution neural network with attention mechanisms to reconstruct the decoupled attribute features into a visual image that is close to the original item image. It ensures all attribute features can be combined to contain complete item information. Next, graph attention networks are constructed to parse multi-level attribute compatibility relationships from three perspectives: intra-attribute, inter-attribute, and item integration relationships. Finally, we use multi-layer perceptrons to fuse the score distributions of the three and output the outfit compatibility score. Experiments conducted on the IQON3000 dataset demonstrate that our model outperforms existing state-of-the-art methods and exhibits good interpretability.
Keyword:
Visualization
Feature extraction
Image reconstruction
Image color analysis
Deconvolution
Cotton
Matrix decomposition
Attribute parsing
graph attention network
image reconstruction
interpretability

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

N
North University of China
学者数:
1.1W
论文数: 6.9K
被引数: 7.7K
S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
引用论文

引用论文

Can CD34 discriminate between benign and malignant hepatocytic lesions in fine-needle aspirates and thin core biopsies?
err2000-11-10
err0
errOAAI
errW. Bastiaan de Boer; Amanda Segal; Felicity A. Frost; Gregory F. Sterrett
err分享
err收藏
A3-FKG: Attentive Attribute-Aware Fashion Knowledge Graph for Outfit Preference Prediction
err2022-01-01
err30
PREAI
errZhan, Huijing; Lin, Jie; Ak, Kenan Emir; Shi, Boxin; Duan, Ling-Yu; Kot, Alex C.
err分享
err收藏
Alpha-1-antitrypsin: New perspectives and clinical applications
err1990-07-01
err0
PREAI
errRoger S. Riley; John R. Forney; Charles A. Bradley; Dale D. Dunn
err分享
err收藏
A Technique for Measuring Petal Gloss, with Examples from the Namaqualand Flora
err2012-01-10
err0
errOAAI
errHeather M. Whitney; Sean A. Rands; Nick J. Elton; Allan G. Ellis
err分享
err收藏
Collagen–elastin ratio predicts burst pressure of arterial seals created using a bipolar vessel sealing device in a porcine model
err2011-03-15
err0
PREAI
errDavid Sindram; Kimberly Martin; Jarrod P. Meadows; Ajita S. Prabhu; Jessica J. Heath; Iain H. McKillop; David A. Iannitti
err分享
err收藏
学者 查看更多内容