arrow
Return

Converting hyperparameter gamma in distance-based loss functions to normal parameter for knowledge graph completion

delete2023-07-09
delete0
PRE
AI
J
Jinglin Zhang
沈
沈波 (Bo Shen) *
王
王涛 (Tao Wang)
Y
Yu Zhong
DOI:10.1007/s10489-023-04790-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The parameter gamma, which is used in distance-based knowledge graph embedding to distinguish positive and negative samples, plays an important role in model performance. Usually, gamma is considered a hyperparameter and taken from a discrete set. However, as the boundary of positive and negative samples, gamma may have a continuous property and be complementary to other parameters. The high consistency between gamma and the learnable parameter with respect to their attributes means that choosing gamma as a hyperparameter is probably not a good choice. To better explore the characteristics of gamma, we propose a multi-iterated parameterized scheme to convert gamma from a hyperparameter to a normal parameter. Two concrete implementation methods, the macro parametrized method and the micro parameterized method, are provided to achieve this conversion. The conversion for gamma can reduce dependency on expert knowledge in the gamma setting and can allow successors to become involved in the recent framework quickly. Experimental results on TransE, RotatE and LineaRE show that the proposed scheme and methods can achieve approximate or better results when compared with those of the original method. A series of experimental analyses further explore the characteristics and illustrate the availability of the proposed parameterized scheme and methods.
Keywords:
Knowledge graph embedding
Knowledge graph completion
Hyperparameter conversion
Parameter learning

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

B
Beijing Jiaotong University
Scholars:
2.2W
Papers: 1.7W
Citations: 1.2W
Cited Papers

Cited Papers

Chapter 20 Methods for Functional Analysis of Macroautophagy in Filamentous Fungi
err2008-01-01
err0
PREAI
errYi Zhen Deng; Marilou Ramos‐Pamplona; Naweed I. Naqvi
errShare
errSave
DBpedia - A large-scale, multilingual knowledge base extracted from Wikipedia
err2015-01-01
err2.0K
errOAAI
errLehmann, Jens; Isele, Robert; Jakob, Max; Jentzsch, Anja; Kontokostas, Dimitris; Mendes, Pablo N.; Hellmann, Sebastian; Morsey, Mohamed; van Kleef, Patrick; Auer, Soeren; Bizer, Christian
errShare
errSave
Surveillance following radical or partial nephrectomy for renal cell carcinoma
err2005-01-01
err0
PREAI
errJohn S. Lam; John T. Leppert; Robert A. Figlin; Arie S. Belldegrun
errShare
errSave
Firing and intrinsic properties of antennal lobe neurons in the Noctuid moth Agrotis ipsilon
err2015-10-01
err0
errOAAI
errCéline Lavialle-Defaix; Vincent Jacob; Christelle Monsempès; Sylvia Anton; Jean-Pierre Rospars; Dominique Martinez; Philippe Lucas
errShare
errSave
researcher View more