arrow
Return

Enhancing BERT Representation With Context-Aware Embedding for Aspect-Based Sentiment Analysis

delete2020-01-01
delete62
delete
OA
AI
X
Xinlong Li
X
Xingyu Fu *
G
Guangluan Xu
Y
Yang Yang
J
Jiuniu Wang
L
Li Jin
Q
Qing Liu
T
Tianyuan Xiang
DOI:10.1109/ACCESS.2020.2978511delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Aspect-based sentiment analysis, which aims to predict the sentiment polarities for the given aspects or targets, is a broad-spectrum and challenging research area. Recently, pre-trained models, such as BERT, have been used in aspect-based sentiment analysis. This fine-grained task needs auxiliary information to distinguish each aspect. But the input form of BERT is only a words sequence which can not provide extra contextual information. To address this problem, we introduce a new method named GBCN which uses a gating mechanism with context-aware aspect embeddings to enhance and control the BERT representation for aspect-based sentiment analysis. Firstly, the input texts are fed into BERT and context-aware embedding layer to generate BERT representation and refined context-aware embeddings separately. These refined embeddings contain the most correlated information selected in the context. Then, we employ a gating mechanism to control the propagation of sentiment features from BERT output with context-aware embeddings. The experiments of our model obtain new state-of-the-art results on the SentiHood and SemEval-2014 datasets, achieving a test F1 of 88.0 and 92.9 respectively.
Keywords:
Aspect-based sentiment analysis
BERT network
context-aware embedding

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704