arrow
Return

Deep hyperbolic convolutional model for knowledge graph embedding

delete2024-09-01
delete0
PRE
AI
M
Ming Y. Lu
Y
Yancong Li
张晓明 cover
张晓明 (Xiaoming Zhang)
DOI:10.1016/j.knosys.2024.112183delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advancements in knowledge graph embedding have enabled the representation of entities and relations in continuous vector spaces. Performing link prediction on incomplete knowledge graphs using these embeddings has emerged as a challenging task, drawing considerable research interest. Knowledge graphs in the real world typically exhibit a natural hierarchical structure. Hyperbolic embedding methods have shown promising results in modeling hierarchical data, especially in low-dimensional representations. However, existing hyperbolic models for knowledge graph embedding are generally shallow, resulting in limited expressiveness. Additionally, some deep hyperbolic models exist but are often constrained to fixed curvature spaces, which may not optimally capture varying hierarchical structures. In this work, we propose DeER, a novel multi-layer hyperbolic model that leverages a trainable curvature space, marking an advancement in the depth and adaptability of hyperbolic modeling for knowledge graph embeddings. We specifically design a hyperbolic convolutional neural network to learn the heterogeneous interactions between entities and relations within this adaptable hyperbolic space. Additionally, we introduce a hyperbolic feedforward neural network to transform hyperbolic features across multiple layers, enhancing the model's ability to capture complex hierarchical relationships. Experimental results on three benchmark datasets demonstrate that DeER significantly enhances expressiveness and hierarchical modeling performance when compared to both shallow and other deep baseline approaches.
Keywords:
Knowledge graph embedding
Link prediction
Hyperbolic geometry
Poincar & eacute
ball
Deep neural networks

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

X
Xingtai University
Scholars:
259
Papers: 189
Citations: 213
B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37