arrow
Return

Uncertainty modeling for inductive knowledge graph embedding

delete2025-04-01
delete0
PRE
AI
C
Chao Liu
S
Sam Kwong
王曦照 cover
王曦照 (Xizhao Wang) *
DOI:10.1016/j.neunet.2024.107103delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the process of refining Knowledge Graphs (KGs), new entities emerge, and old entities evolve, which usually updates their attribute information and neighborhood structures. This results in a distribution shift problem for entity features in the embedding space during graph representation learning. Most of existing inductive knowledge graph embedding methods focus mainly on the representation learning of new entities, neglecting the negative impact caused by distribution shift of entity features. In this paper, we use the skill of mean and variance reconstruction to develop a novel inductive knowledge graph embedding model named EDSU for processing the shift of entity feature distribution. Specifically, by assuming that the embedding feature of entity follows multivariate Gaussian distribution, the reconstruction combines the distribution characteristics of components in an entity embedding vector with neighborhood structure information of a set of entity embedding vectors, in order to alleviate the deviation of data information between intra-entity and inter-entity. Furthermore, the connection between the entity features distributions before and after the shift is established, which guides the model training process and provides an interpretation on the rationality of such handling distribution shift in view of distributional data augmentation. Extensive experiments have been conducted and the results demonstrate that our EDSU model outperforms previous state-of-the-art baseline models on inductive link prediction tasks.
Keywords:
Distribution shift
Embedding space
Graph representation learning
Reconstruction
Inductive link prediction

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

L
Lingnan University
Scholars:
1.0K
Papers: 1.4K
Citations: 202
S
shenzhen university
Scholars:
4.6W
Papers: 3.4W
Citations: 72
Cited Papers

Cited Papers

MixStyle Neural Networks for Domain Generalization and Adaptation
err2023-10-17
err11
PREAI
errZhou, Kaiyang; Yang, Yongxin; Qiao, Yu; Xiang, Tao
errShare
errSave
Synthesis and immunochemical evaluation of a novel Neisseria meningitidis serogroup A tetrasaccharide and its conjugate
err2017-01-01
err0
PREAI
errKishore R. Harale; Jeetendra K. Rout; Manoj Kumar Chhikara; Davinder S. Gill; Anup Kumar Misra
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
In-depth phenotypic characterization of multicellular tumor spheroids: Effects of 5-Fluorouracil
err2017-11-15
err0
errOAAI
errAngélique Virgone-Carlotta; Manon Lemasson; Hichem C. Mertani; Jean-Jacques Diaz; Sylvain Monnier; Thomas Dehoux; Hélène Delanoë-Ayari; Charlotte Rivière; Jean-Paul Rieu
errShare
errSave
Knowledge Graph Embedding for Link Prediction: A Comparative Analysis
err2021-01-04
err346
errOAAI
errRossi, Andrea; Barbosa, Denilson; Firmani, Donatella; Matinata, Antonio; Merialdo, Paolo
errShare
errSave
researcher View more