.png){kind=icon}
返回
Multimodal Attentive Representation Learning for Micro-video Multi-label Classification
.png){kind=icon}
PRE
AI
DOI：10.1145/3643888.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
As one of the representative types of user-generated contents (UGCs) in social platforms, micro-videos have been becoming popular in our daily life. Although micro-videos naturally exhibit multimodal features that are rich enough to support representation learning, the complex correlations across modalities render valuable information difficult to integrate. In this paper, we introduced a multimodal attentive representation network (MARNET) to learn complete and robust representations to benefit micro-video multi-label classification. To address the commonly missing modality issue, we presented a multimodal information aggregation mechanism module to integrate multimodal information, where latent common representations are obtained by modeling the complementarity and consistency in terms of visual-centered modality groupings instead of single modalities. For the label correlation issue, we designed an attentive graph neural network module to adaptively learn the correlation matrix and representations of labels for better compatibility with training data. In addition, a cross-modal multi-head attention module is developed to make the learned common representations label-aware for multi-label classification. Experiments conducted on two micro-video datasets demonstrate the superior performance of MARNET compared with state-of-the-art methods.
Keyword:
Micro-video
multimodal representations
multi-label
graph network
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
Reduced cortical excitatory synapse number in APOE4 mice is associated with increased calcineurin activity.png)
NeuroReport
OAAI
NeuroReportIF0
OAAI分享收藏分享收藏
查看更多内容