.png){kind=icon}
Return
MCCI: A multi-channel collaborative interaction framework for multimodal knowledge graph completion
.png){kind=icon}
PRE
AI
DOI：10.1016/j.ipm.2025.104156.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multimodal knowledge graph completion (MKGC) aims to leverage multimodal information to predict missing fact triplets. However, existing MKGC approaches largely ignore the heterogeneity and interaction complexity between modal details, resulting in a lack of balance in the intra-and inter-modal expression. To address the above challenges, we propose a novel multichannel collaborative interaction (MCCI) framework for MKGC, which is composed of feature encoding, dual-flow alignment, and decision fusion modules. Specifically, in the encoding stage, information filtering and visual enhancement-based methods are used to capture high-quality multimodal features. Furthermore, the dual-flow alignment module expands the potential correlations between different modalities, thereby facilitating the interaction frequency of the information. In the fusion stage, dynamically allocate modality weights and generate prediction outcomes. Experimental results show that compared with the state-of-the-art approaches, the proposed MCCI framework has an improvement of 5.7% and 19.8% in Hits@10 and MR, respectively.
Keywords:
Knowledge graph completion
Multimodal knowledge graph
Knowledge alignment
Decision fusion
Journal
I
IF:
6.9
Papers:
5.2K
Citations:
1.4W
Organization
Cited Papers
.png){kind=icon}
Explainable Knowledge reasoning via thought chains for knowledge-based visual question answering
PREAI
ShareSaveShareSaveShareSaveRelaGraph: Improving embedding on small-scale sparse knowledge graphs by neighborhood relations
PREAI
ShareSave
View more