arrow
Return

Learning hyperbolic attention-based embeddings for link prediction in knowledge graphs

delete2021-10-01
delete21
PRE
AI
A
Adnan Zeb
A
Anwar Ul Haq
J
Junde Chen
Z
Zhenfeng Lei
D
Defu Zhang *
DOI:10.1016/j.knosys.2021.107369delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Knowledge graph (KG) embedding methods aim to learn low-dimensional representations of entities and relations to predict new valid triples for KG completion. Most of the existing KG embedding models learn embeddings in Euclidean space, which cannot accurately capture hierarchical structures and complex properties of relations found in KGs. To this effect, a recent model MuRP, as a first hyperbolic method, learns the KG embeddings in hyperbolic space and outperforms existing Euclidean embedding models. However, MuRP treats the KG triples individually, and hence fails to capture the complex structural information inherent in the local vicinity of a node, leading to low-quality node embeddings. On the other hand, the recent hyperbolic graph neural network (HGNN) provides a way of learning high-quality hyperbolic node embeddings by capturing information from each node's neighborhood. However, HGNN ignores the relation features and treats all neighboring nodes with equal importance. To this end, we propose RHGNN, which extends HGNN by including the relation features and performing a hyperbolic attention-based neighborhood aggregation. We then combine RHGNN with MuRP into a novel encoder-decoder hyperbolic embedding learning framework (which we call HyperGEL) for KG completion. RHGNN gathers information from the neighboring nodes to generate rich hyperbolic node embeddings, and MuRP uses these embeddings to predict new triples. Experimental results show the proposed framework's effectiveness that consistently marks performance gains over several previous models on recent standard KG completion datasets. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Knowledge graph
Link prediction
Graph neural network
Hyperbolic graph neural network
Poincare ball model
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

X
xiamen university
Scholars:
5.8W
Papers: 3.8W
Citations: 67