Self-attention-based conditional random fields latent variables model for sequence labeling

doi:10.1016/j.patrec.2021.02.008

Self-attention-based conditional random fields latent variables model for sequence labeling

2021-05-01

42

OA

AI

DOI：10.1016/j.patrec.2021.02.008

Original

Save

View PDF

Abstract

En 中文

To process data like text and speech, Natural Language Processing (NLP) is a valuable tool. As on of NLP?s upstream tasks, sequence labeling is a vital part of NLP through techniques like text classification, machine translation, and sentiment analysis. In this paper, our focus is on sequence labeling where we assign semantic labels within input sequences. We present two novel frameworks, namely SA-CRFLV-I and SA-CRFLV-II, that use latent variables within random fields. These frameworks make use of an encoding schema in the form of a latent variable to be able to capture the latent structure in the observed data. SA-CRFLV-I shows the best performance at the sentence level whereas SA-CRFLV-II works best at the word level. In our in-depth experimental results, we compare our frameworks with 4 well-known sequence prediction methodologies which include NER, reference parsing, chunking as well as POS tagging. The proposed frameworks are shown to have better performance in terms of many well-known metrics. (c)& nbsp;2021 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )

Keywords:

Latent CRF

Sequence labeling

Encoding schema

Natural language processing

VQA

Big data

Self-attention-based conditional random fields latent variables model for sequence labeling

Abstract

AI Summary

Journal

Organization