arrow
返回

SADCMF: Self-Attentive Deep Consistent Matrix Factorization for Micro-Video Multi-Label Classification

delete2024-01-01
delete1
PRE
AI
F
Fugui Fan
井佩光 封面图
井佩光 (Peiguang Jing)
Liqiang Nie 封面图
Liqiang Nie (Liqiang Nie)
H
Haoyu Gu
苏育挺 封面图
苏育挺 (Yuting Su) *
DOI:10.1109/TMM.2024.3406196delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Currently, there is a growing scholarly and industrial interest in micro-video-centric research. Within these domains, multi-label learning has emerged as a fundamental yet attractive subject. Existing methods primarily place emphasis on feature representations of individual micro-videos, while neglecting latent interdependencies between instance and label domains. To address this problem, in this paper, we propose a novel self-attentive deep consistent matrix factorization (SADCMF) method, which jointly explores dual-domain hierarchical representations and their inherent dependencies for micro-video multi-label classification. Specifically, SADCMF includes three primary characteristics. 1) A dual-domain deep collaborative factorization module is developed to explore the first-stage representations of instance features and the discriminative embeddings of label semantics in a mutually beneficial manner. 2) A correlation-driven self-attentive factorization module is devised to acquire the label-aware attentive outputs, which are further combined with original features through a residual structure to enrich the second-stage feature representations. 3) A dual-stream representation consistency module ensures the unidirectional and bidirectional representation consistency, meanwhile, narrows the discrepancies between the two-stage representations for improving the generalization ability of our method. Extensive experiments conducted on two publicly available micro-video multi-label datasets demonstrate its superior performance in comparison with state-of-the-art methods.
Keyword:
Correlation
Semantics
Task analysis
Collaboration
Visualization
Social networking (online)
Fans
Micro-video
multi-label classification
deep matrix factorization
self-attention

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.7K
被引数:
2.4W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
引用论文

引用论文

Perioperative Corticosteroid Management for Patients with Inflammatory Bowel Disease
err2015-01-01
err0
errOAAI
errCaitlin W. Hicks; Elizabeth C. Wick; Roberto Salvatori; Christina Y. Ha
err分享
err收藏
err分享
err收藏
The Social Impact of Events in Social Media Conversation
err2014-12-27
err0
PREAI
errAlessandro Inversini; Rogan Sage; Nigel Williams; Dimitrios Buhalis
err分享
err收藏
Neural Multimodal Cooperative Learning Toward Micro-Video Understanding
err2020-01-01
err108
PREAI
errWei, Yinwei; Wang, Xiang; Guan, Weili; Nie, Liqiang; Lin, Zhouchen; Chen, Baoquan
err分享
err收藏
err分享
err收藏
YFCC100M: The New Data in Multimedia ResearchYFCC100M: 多媒体研究中的新数据
err2016-01-25
err1.1K
errOAAI
errThomee, Bart; Elizalde, Benjamin; Shamma, David A.; Ni, Karl; Friedland, Gerald; Poland, Douglas; Borth, Damian; Li, Li-Jia
err分享
err收藏
学者 查看更多内容