arrow
返回

Enhancing BERT Representation With Context-Aware Embedding for Aspect-Based Sentiment Analysis

delete2020-01-01
delete62
delete
OA
AI
X
Xinlong Li
X
Xingyu Fu *
G
Guangluan Xu
Y
Yang Yang
J
Jiuniu Wang
L
Li Jin
Q
Qing Liu
T
Tianyuan Xiang
DOI:10.1109/ACCESS.2020.2978511delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Aspect-based sentiment analysis, which aims to predict the sentiment polarities for the given aspects or targets, is a broad-spectrum and challenging research area. Recently, pre-trained models, such as BERT, have been used in aspect-based sentiment analysis. This fine-grained task needs auxiliary information to distinguish each aspect. But the input form of BERT is only a words sequence which can not provide extra contextual information. To address this problem, we introduce a new method named GBCN which uses a gating mechanism with context-aware aspect embeddings to enhance and control the BERT representation for aspect-based sentiment analysis. Firstly, the input texts are fed into BERT and context-aware embedding layer to generate BERT representation and refined context-aware embeddings separately. These refined embeddings contain the most correlated information selected in the context. Then, we employ a gating mechanism to control the propagation of sentiment features from BERT output with context-aware embeddings. The experiments of our model obtain new state-of-the-art results on the SentiHood and SemEval-2014 datasets, achieving a test F1 of 88.0 and 92.9 respectively.
Keyword:
Aspect-based sentiment analysis
BERT network
context-aware embedding

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Unchanged cerebrovascular CO2 reactivity and hypercapnic ventilatory response during strict head‐down tilt bed rest in a mild hypercapnic environment
err2020-05-02
err0
errOAAI
errSteven S. Laurie; Kate Christian; Jacob Kysar; Stuart M.C. Lee; Andrew T. Lovering; Brandon R. Macias; Stefan Moestl; Wolfram Sies; Edwin Mulder; Millennia Young; Michael B. Stenger
err分享
err收藏
Enhancement of pyramid solar distiller performance using reflectors, cooling cycle, and dangled cords of wicks
err2021-06-01
err0
PREAI
errF.A. Essa; Wissam H. Alawee; Suha A. Mohammed; A.S. Abdullah; Z.M. Omara
err分享
err收藏
Origin and Global Expansion of Mycobacterium tuberculosis Complex Lineage 3
err2022-05-31
err0
errOAAI
errYassir A. Shuaib; Christian Utpatel; Thomas A. Kohl; Ivan Barilar; Margo Diricks; Nadia Ashraf; Lothar H. Wieler; Glennah Kerubo; Eyob A. Mesfin; Awa Ba Diallo; Sahal Al-Hajoj; Perpetua Ndung’u; Margaret M. Fitzgibbon; Farzam Vaziri; Vitali Sintchenko; Elena Martinez; Sofia O. Viegas; Yang Zhou; Aya Azmy; Khaled Al-Amry; Sylvain Godreuil; Mandira Varma-Basil; Anshika Narang; Solomon Ali; Patrick Beckert; Viola Dreyer; Mwila Kabwe; Matthew Bates; Michael Hoelscher; Andrea Rachow; Andrea Gori; Emmanuel M. Tekwu; Larissa K. Sidze; Assam A. Jean-Paul; Veronique P. Beng; Francine Ntoumi; Matthias Frank; Aissatou Gaye Diallo; Souleymane Mboup; Belay Tessema; Dereje Beyene; Sadiq N. Khan; Roland Diel; Philip Supply; Florian P. Maurer; Harald Hoffmann; Stefan Niemann; Matthias Merker
err分享
err收藏
err分享
err收藏
Development of neuroendocrine lineages requires the bHLH–PAS transcription factor SIM1
err1998-10-15
err0
errOAAI
errJacques L. Michaud; Thomas Rosenquist; Noah R. May; Chen-Ming Fan
err分享
err收藏
学者 查看更多内容