arrow
Return

Convolutional multi-head self-attention on memory for aspect sentiment classification

delete2020-07-01
delete62
PRE
AI
Y
Yaojie Zhang *
徐兵 (Bing Xu)
T
Tiejun Zhao
DOI:10.1109/JAS.2020.1003243delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents a method for aspect based sentiment classification tasks, named convolutional multi-head self-attention memory network (CMA-MemNet). This is an improved model based on memory networks, and makes it possible to extract more rich and complex semantic information from sequences and aspects. In order to fix the memory network's inability to capture context-related information on a word-level, we propose utilizing convolution to capture n-gram grammatical information. We use multi-head self-attention to make up for the problem where the memory network ignores the semantic information of the sequence itself. Meanwhile, unlike most recurrent neural network (RNN) long short term memory (LSTM), gated recurrent unit (GRU) models, we retain the parallelism of the network. We experiment on the open datasets SemEval-2014 Task 4 and SemEval-2016 Task 6. Compared with some popular baseline methods, our model performs excellently.
Keywords:
Aspect sentiment classification
deep learning
memory network
sentiment analysis (SA)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
IEEE-CAA Journal of Automatica Sinica
IF:
19.2
Papers:
1.4K
Citations:
1.1W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66