arrow
Return

MMIEA: Multi-modal Interaction Entity Alignment model for knowledge graphs

delete2023-12-01
delete2
PRE
AI
B
Bin Zhu
M
Meng Wu
Y
Yunpeng Hong
陈
陈宜 (Yi Chen)
B
Bo Xie
F
Fei Liu
C
Chenyang Bu *
丁卫平 cover
丁卫平 (Weiping Ding) *
DOI:10.1016/j.inffus.2023.101935delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Fusing data from different sources to improve decision making in smart cities has received increasing attention. Collected data through sensors usually exist in a multi-modal form, such as values, images, and texts. Thus, designing models that handle multi-modal data has an important role in this field. Meanwhile, security and privacy issues cannot be ignored, as the leakage of big data may provide opportunities for criminals. To solve the above challenges, we focus on research on multi-modal entity alignment for knowledge graphs and proposed the Multi-Modal Interaction Entity Alignment model (MMIEA). The model is proposed from the perspective of fusing data from different modalities while maintaining privacy. We determined that the model is privacy-preserving because it does not need to transmit the raw data of each modality (only the vector representation is transmitted). Specifically, we introduce and improve the BERT-INT model for the entity alignment task in multi-modal knowledge graphs. Experimental results on two commonly used multi -modal datasets show that our method outperforms 17 algorithms, including nine multi-modal entity alignment methods.
Keywords:
Multi-modal
Knowledge graph
Entity alignment
Interaction
BERT

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.3K
Citations:
2.7W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
N
Nantong University
Scholars:
1.9W
Papers: 1.1W
Citations: 2.0W
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
researcher View more organizations
Cited Papers

Cited Papers

Parent and Adolescent Satisfaction with Mental Health Services: Does it Relate to Youth Diagnosis, Age, Gender, or Treatment Outcome?
err2010-02-05
err0
PREAI
errJessica A. Turchik; Veronika Karpenko; Benjamin M. Ogles; Petya Demireva; Danielle R. Probst
errShare
errSave
TLR10 Is a Negative Regulator of Both MyD88-Dependent and -Independent TLR Signaling
err2016-05-01
err0
errOAAI
errSong Jiang; Xinyan Li; Nicholas J. Hess; Yue Guan; Richard I. Tapping
errShare
errSave
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
err2022-02-01
err1.3K
errOAAI
errJi, Shaoxiong; Pan, Shirui; Cambria, Erik; Marttinen, Pekka; Yu, Philip S.
errShare
errSave
DBpedia - A large-scale, multilingual knowledge base extracted from Wikipedia
err2015-01-01
err2.0K
errOAAI
errLehmann, Jens; Isele, Robert; Jakob, Max; Jentzsch, Anja; Kontokostas, Dimitris; Mendes, Pablo N.; Hellmann, Sebastian; Morsey, Mohamed; van Kleef, Patrick; Auer, Soeren; Bizer, Christian
errShare
errSave
Optical coatings in microscale channels by atomic layer deposition
err2010-03-03
err0
PREAI
errNicholas T. Gabriel; Joseph J. Talghader
errShare
errSave
Present Status of Theory: 1/N Approach
err1984-01-01
err0
PREAI
errPhilip W. Anderson
errShare
errSave
Soluble Toll-like receptor 2 is a biomarker for sepsis in critically ill patients with multi-organ failure within 12 h of ICU admission
err2017-01-13
err0
errOAAI
errBenjamin Holst; Tamas Szakmany; Anne-Catherine Raby; Vincent Hamlyn; Kimberley Durno; Judith E. Hall; Mario O. Labéta
errShare
errSave
Study of the mechanical and microstructural state of platinum thin films
err1996-01-01
err0
PREAI
errV. Branger; V. Pelosin; K.F. Badawi; Ph. Goudeau
errShare
errSave
A transcriptome analysis of isoamyl alcohol-induced filamentation in yeast reveals a novel role for Gre2p as isovaleraldehyde reductase
err2007-01-01
err0
errOAAI
errMichael Hauser; Patrick Horn; Helene Tournu; Nicole C. Hauser; Jörg D. Hoheisel; Alistair J. P. Brown; J. Richard Dickinson
errShare
errSave
researcher View more