arrow
返回

Learning Context Using Segment-Level LSTM for Neural Sequence Labeling

delete2020-01-01
delete11
PRE
AI
Y
Youhyun Shin *
S
Sang‐Goo Lee
DOI:10.1109/TASLP.2019.2948773delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article introduces an approach that learns segment-level context for sequence labeling in natural language processing (NLP). Previous approaches limit their basic unit to a word for feature extraction because sequence labeling is a token-level task in which labels are annotated word-by-word. However, the text segment is an ultimate unit for labeling, and we are easily able to obtain segment information from annotated labels in a IOB/IOBES format. Most neural sequence labeling models expand their learning capacity by employing additional layers, such as a character-level layer, or jointly training NLP tasks with common knowledge. The architecture of our model is based on the charLSTM-BiLSTM-CRF model, and we extend the model with an additional segment-level layer called segLSTM. We therefore suggest a sequence labeling algorithm called charLSTM-BiLSTM-CRF-segLSTM(sLM) which employs an additional segment-level long short-term memory (LSTM) that trains features by learning adjacent context in a segment. We demonstrate the performance of our model on four sequence labeling datasets, namely, Peen Tree Bank, CoNLL 2000, CoNLL 2003, and OntoNotes 5.0. Experimental results show that our model performs better than state-of-the-art variants of BiLSTM-CRF. In particular, the proposed model enhances the performance of tasks for finding appropriate labels of multiple token segments.
Keyword:
Sequence labeling
joint learning
language modeling
BiLSTM-CRF
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
引用论文

引用论文

err2002-01-01
err0
PREAI
errHisashi Ômura; Yasumasa Kuwahara; Tsutomu Tanabe
err分享
err收藏
Effect of thermal annealing on the structural and mechanical properties of amorphous silicon carbide films prepared by polymer-source chemical vapor deposition
err2010-03-01
err0
PREAI
errY. Awad; M.A. El Khakani; D. Brassard; R. Smirani; N. Camiré; M. Lessard; C. Aktik; M. Scarlete; J. Mouine
err分享
err收藏
Language MOOCs: An expanding field
err2019-06-30
err0
errOAAI
errNapat Jitpaisarnwattana; Hayo Reinders; Pornapit Darasawang
err分享
err收藏
YAC transgene-mediated olfactory receptor gene choiceYAC转基因介导的嗅觉受体基因选择
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
err分享
err收藏
The Evolution of Combinatorial Gene Regulation in Fungi
err2008-02-26
err0
errOAAI
errBrian B Tuch; David J Galgoczy; Aaron D Hernday; Hao Li; Alexander D Johnson
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容