arrow
Return

Relation classification via knowledge graph enhanced transformer encoder

delete2020-10-01
delete19
PRE
AI
W
Wenti Huang
毛
毛宜钰 (Yiyu Mao)
Z
Zhan Yang
朱磊 cover
朱磊 (Lei Zhu)
J
Jun Long *
DOI:10.1016/j.knosys.2020.106321delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Relation classification is an important task in natural language processing fields. The goal is to predict predefined relations for the marked nominal pairs in given sentences. State-of-the-art works usually focus on using deep neural networks as classifier to conduct the relation prediction. The rich semantic information of relationships in the triples of existing knowledge graph (KG) can be used as additional supervision for relation classification. However, these relationships were simply used as labels to specify the class of sentences in previous works, and their semantic information was completely ignored. In this paper, a novel approach is proposed for relation classification, which jointly uses information from textual sentences and knowledge graphs. To this end, we introduce a Transformer encoder to measure the semantic similarity between sentences and relation types. Besides, we connect the semantic information of marked nominals in sentences with that of the corresponding entities in knowledge graph to generate the semantic matching information between textual relations and KG relations. The matching information can provide additional supervision for relation classification. Since the words and entities are used interactively with each other in our work, we propose an embedding translating strategy to handle the semantic gap problem between word embeddings and entity embeddings. Experimental results on two widely used datasets, SemEval-2010 Task 8 and TACRED, show that our approach is able to efficiently use the semantic information from the knowledge graph to enhance the performance of the Transformer encoder for relation classification. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Relation classification
Knowledge graph embedding
Transformer
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

C
Central South University
Scholars:
10.0W
Papers: 7.2W
Citations: 10.9W
Cited Papers

Cited Papers

Mortality in heart failure: clinical variables of prognostic value.
err1987-12-01
err0
errOAAI
errJ G Cleland; H J Dargie; I Ford
errShare
errSave
Metabolism of substance P and bradykinin by human neutrophils
err1991-05-01
err0
PREAI
errRandal A. Skidgel; Herbert L. Jackman; Ervin G. Erdös
errShare
errSave
A model for Cryogenian iron formation
err2016-01-01
err0
PREAI
errGrant M. Cox; Galen P. Halverson; André Poirier; Daniel Le Heron; Justin V. Strauss; Ross Stevenson
errShare
errSave
Shift from nival to pluvial recharge of an aquifer-fed lake increases water temperature
err2019-05-31
err0
errOAAI
errGiovanna Flaim; Ami Nishri; Federica Camin; Stefano Corradini; Ulrike Obertegger
errShare
errSave
errShare
errSave
errShare
errSave
Viperin binds STING and enhances the type-I interferon response following dsDNA detection
err
IF0
err2018-12-11
err0
errOAAI
errKeaton M. Crosse; Ebony A. Monson; Arti B. Dumbrepatil; Monique Smith; Yeu-Yang Tseng; Kylie H. Van der Hoek; Peter A. Revill; David C. Tscharke; E. Neil. G. Marsh; Michael R. Beard; Karla J. Helbig
errShare
errSave
Bilinear joint learning of word and entity embeddings for Entity Linking
err2018-06-01
err15
errOAAI
errChen, Hui; Wei, Baogang; Liu, Yonghuai; Li, Yiming; Yu, Jifang; Zhu, Wenhao
errShare
errSave
researcher View more