arrow
返回

Converting hyperparameter gamma in distance-based loss functions to normal parameter for knowledge graph completion

delete2023-07-09
delete0
PRE
AI
J
Jinglin Zhang
沈
沈波 (Bo Shen) *
王
王涛 (Tao Wang)
Y
Yu Zhong
DOI:10.1007/s10489-023-04790-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The parameter gamma, which is used in distance-based knowledge graph embedding to distinguish positive and negative samples, plays an important role in model performance. Usually, gamma is considered a hyperparameter and taken from a discrete set. However, as the boundary of positive and negative samples, gamma may have a continuous property and be complementary to other parameters. The high consistency between gamma and the learnable parameter with respect to their attributes means that choosing gamma as a hyperparameter is probably not a good choice. To better explore the characteristics of gamma, we propose a multi-iterated parameterized scheme to convert gamma from a hyperparameter to a normal parameter. Two concrete implementation methods, the macro parametrized method and the micro parameterized method, are provided to achieve this conversion. The conversion for gamma can reduce dependency on expert knowledge in the gamma setting and can allow successors to become involved in the recent framework quickly. Experimental results on TransE, RotatE and LineaRE show that the proposed scheme and methods can achieve approximate or better results when compared with those of the original method. A series of experimental analyses further explore the characteristics and illustrate the availability of the proposed parameterized scheme and methods.
Keyword:
Knowledge graph embedding
Knowledge graph completion
Hyperparameter conversion
Parameter learning

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

Chapter 20 Methods for Functional Analysis of Macroautophagy in Filamentous Fungi
err2008-01-01
err0
PREAI
errYi Zhen Deng; Marilou Ramos‐Pamplona; Naweed I. Naqvi
err分享
err收藏
DBpedia - A large-scale, multilingual knowledge base extracted from WikipediaDBpedia-从维基百科中提取的大规模多语言知识库
err2015-01-01
err2.0K
errOAAI
errLehmann, Jens; Isele, Robert; Jakob, Max; Jentzsch, Anja; Kontokostas, Dimitris; Mendes, Pablo N.; Hellmann, Sebastian; Morsey, Mohamed; van Kleef, Patrick; Auer, Soeren; Bizer, Christian
err分享
err收藏
Firing and intrinsic properties of antennal lobe neurons in the Noctuid moth Agrotis ipsilon
err2015-10-01
err0
errOAAI
errCéline Lavialle-Defaix; Vincent Jacob; Christelle Monsempès; Sylvia Anton; Jean-Pierre Rospars; Dominique Martinez; Philippe Lucas
err分享
err收藏
学者 查看更多内容