返回
Enhancing BERT Representation With Context-Aware Embedding for Aspect-Based Sentiment Analysis
DOI:10.1109/ACCESS.2020.2978511.png)
摘要
En 中文
Aspect-based sentiment analysis, which aims to predict the sentiment polarities for the given aspects or targets, is a broad-spectrum and challenging research area. Recently, pre-trained models, such as BERT, have been used in aspect-based sentiment analysis. This fine-grained task needs auxiliary information to distinguish each aspect. But the input form of BERT is only a words sequence which can not provide extra contextual information. To address this problem, we introduce a new method named GBCN which uses a gating mechanism with context-aware aspect embeddings to enhance and control the BERT representation for aspect-based sentiment analysis. Firstly, the input texts are fed into BERT and context-aware embedding layer to generate BERT representation and refined context-aware embeddings separately. These refined embeddings contain the most correlated information selected in the context. Then, we employ a gating mechanism to control the propagation of sentiment features from BERT output with context-aware embeddings. The experiments of our model obtain new state-of-the-art results on the SentiHood and SemEval-2014 datasets, achieving a test F1 of 88.0 and 92.9 respectively.
Keyword:
Aspect-based sentiment analysis
BERT network
context-aware embedding
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Spatial patterns of agrazing intensity on a caribbean barrier reef: Herbivory and algal distribution
Enhancement of pyramid solar distiller performance using reflectors, cooling cycle, and dangled cords of wicks
Desalination
IF0
Cobalt and Copper Composite Oxides as Efficient Catalysts for Preferential Oxidation of CO in H2-Rich Stream钴和铜复合氧化物作为H2-Rich流中CO优先氧化的有效催化剂

