arrow
Return

A lightweight framework for knowledge graph representation learning models based on knowledge distillation strategy

delete2025-09-02
delete0
delete
OA
AI
Q
Qiuhui Shen
H
Hongjun Zhang
A
Aiyan Qu
董仕 (Shi Dong) *
DOI:10.1007/s40747-025-02064-8delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
With the continuous expansion of traditional knowledge graph scales and deepening research, the design of models has become increasingly complex to enhance knowledge representation capabilities. This not only increases the required computational support but also brings significant computational and storage overheads, making deploying knowledge graphs to terminal devices a major challenge. To address the issues of high computational and storage costs of knowledge graph representation learning models, which are difficult to deploy on resource-constrained terminal devices, a model lightweighting framework based on knowledge distillation technology is thoroughly investigated and proposed. This framework employs a complex high-performance model as the teacher model and a low-dimensional model as the student model. With the assistance of the teacher, lightweighting of high-dimensional models can be achieved through training while minimizing loss of performance. Experiments with nine different models on four general datasets validate the scientific, effective, and practical nature of the proposed lightweighting framework.
Keywords:
Knowledge graph
Knowledge graph representation learning model
Lightweighting
Knowledge distillation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Complex and Intelligent Systems cover
Complex and Intelligent Systems
IF:
4.6
Papers:
2.1K
Citations:
6.6K

Organization

S
School of Computer Science and Technology
Scholars:
1.4K
Papers: 544
Citations: 0
C
College of Command and Control Engineering
Scholars:
3
Papers: 3
Citations: 0