arrow
Return

Gradient-decomposition based continual embedding method for growing knowledge graphs

delete2026-02-28
delete0
PRE
AI
M
Meihua Wang
J
Jie Huang
W
Wen Wen *
R
Ruichu Cai
P
Peijie Huang
Y
Yuhong Xu
X
Xinlong Ling
DOI:10.1007/s13042-026-02997-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing knowledge graph (KG) embedding models are typically designed to facilitate the representation learning of static KGs. However, KGs tend to evolve and expand over time, and existing methods are unable to adapt to the growing KGs. How to obtain useful information from new facts and inject them to the previous-learned embeddings is critical but challenging for the effective representation of growing KG. In this paper, we proposed a continual embedding method of knowledge graph to efficiently learn information from the new triples and overcome the catastrophic forgetting problem on the existing triples. By dividing the overall loss of the embedding model into the loss on the previous triple set and the newly-arrived triple set, we transform the continual embedding task into a constrained optimization problem. And then a deft working-set decomposition and gradient decomposition strategy is proposed to efficiently train the continual embedding model. Three benchmark datasets are used to evaluate the performance of the proposed method, and the results demonstrate that it exhibits advantageous performance compared to the state-of-the-art models.
Keywords:
Growing knowledge graphs
Representation learning
Embedding
Continual learning
Incremental learning

Journal

International Journal of Machine Learning and Cybernetics cover
International Journal of Machine Learning and Cybernetics
IF:
2.7
Papers:
3.2K
Citations:
5.6K

Organization

C
computer science
Scholars:
1.5K
Papers: 737
Citations: 0
C
College of Mathematics and Informatics
Scholars:
39
Papers: 14
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
Towards Continual Knowledge Graph Embedding via Incremental Distillation
err2024-03-24
err0
errOAAI
errJiajun Liu; Wenjun Ke; Peng Wang; Ziyu Shang; Jinhua Gao; Guozheng Li; Ke Ji; Yanhe Liu
errShare
errSave
Convex Optimization
err
IF0
err2013-08-05
err0
PREAI
errStephen Boyd; Lieven Vandenberghe
errShare
errSave
Graph-Embedding Empowered Entity Retrieval
err2020-04-08
err0
errOAAI
errEmma J. Gerritse; Faegheh Hasibi; Arjen P. de Vries
errShare
errSave
researcher View more