arrow
Return

Hierarchical multi-task learning with CRF for implicit discourse relation recognition

delete2020-05-01
delete14
PRE
AI
邬昌兴 cover
邬昌兴 (Changxing Wu)
R
Ruochen Li
H
Hongyu Lin
J
Jinsong Su *
DOI:10.1016/j.knosys.2020.105637delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Implicit discourse relation recognition (IDRR) remains an ongoing challenge. Recently, various neural network models have been proposed for this task, and have achieved promising results. However, almost all of them predict multi-level discourse senses separately, which not only ignores the semantic hierarchy of and mapping relationships between senses, but also may result in inconsistent predictions at different levels. In this paper, we propose a hierarchical multi-task neural network with a conditional random field layer (HierMTN-CRF) for multi-level IDRR. Specifically, a HierMTN component is designed to jointly model multi-level sense classifications, with these senses as supervision signals at different feature layers. Consequently, the hierarchical semantics of senses are explicitly encoded into features at different layers. To further exploit the mapping relationships between adjacent-level senses, a CRF layer is introduced to perform collective sense predictions. In this way, our model infers a sequence of multi-level senses rather than separate sense predictions in previous models. In addition, our model can be easily constructed based on existing IDRR models. Experimental results and in-depth analyses on the benchmark PDTB data set show that our model achieves significantly better and more consistent results over several competitive baselines on multi-level IDRR, without additional time overhead. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Multi-level implicit discourse relation recognition
Hierarchical multi-task neural network
Conditional random field layer
Semantic hierarchy
Mapping relationship
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

I
institute of software, cas
Scholars:
445
Papers: 387
Citations: 0
U
University of Stuttgart
Scholars:
1.1W
Papers: 9.4K
Citations: 1.3W
E
East China Jiaotong University
Scholars:
4.1K
Papers: 2.9K
Citations: 2.9K
C
chinese academy of sciences
Scholars:
56.6W
Papers: 44.9W
Citations: 704
researcher View more organizations