arrow
Return

DFMKE: A dual fusion multi-modal knowledge graph embedding framework for entity alignment

delete2023-02-01
delete21
PRE
AI
J
Jia Zhu
黄昌勤 (Changqin Huang) *
P
Pasquale De Meo
DOI:10.1016/j.inffus.2022.09.012delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Entity alignment is critical for multiple knowledge graphs (KGs) integration. Although researchers have made significant efforts to explore the relational embeddings between different KGs, existing approaches may not describe multi-modal knowledge well in some tasks, e.g., entity alignment. In this paper, we propose DFMKE, a dual fusion multi-modal knowledge graph embedding framework, to address entity alignment. We first devise an early fusion method for fusing features of multi-modal entity representations of a KG. Simultaneously, multiple representations of various types of knowledge are generated independently by various techniques and fused by a low-rank multi-modal late fusion method. Finally, the outputs of early and late fusion methods are combined using a dual fusion scheme. DFMKE provides an ultimate fusion solution by leveraging the advantages of early and late fusion methods. Extensive experiments on two public datasets show that the DFMKE outperforms state-of-the-art methods by a significant margin achieving at least 10% more regard to Hits@n and MRR metrics.
Keywords:
Knowledge graph
Entity alignment
Neural networks
Multi-modal knowledge

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.1K
Citations:
2.7W

Organization

Z
Zhejiang Normal University
Scholars:
1.3W
Papers: 8.4K
Citations: 1.2W
U
University of Messina
Scholars:
1.5W
Papers: 1.1W
Citations: 1.1W