Context-Aware Dynamic Word Embeddings for Aspect Term Extraction

Jingyun Xu

doi:10.1109/TAFFC.2023.3262941

Context-Aware Dynamic Word Embeddings for Aspect Term Extraction

2024-01-01

4

PRE

AI

DOI：10.1109/TAFFC.2023.3262941

Original

Original request for help

Save

Abstract

En 中文

The aspect term extraction (ATE) task aims to extract aspect terms describing a part or an attribute of a product from review sentences. Most existing works rely on either general or domain embedding to address this problem. Despite the promising results, the importance of general and domain embeddings is still ignored by most methods, resulting in degraded performances. Besides, word embedding is also related to downstream tasks, and how to regularize word embeddings to capture context-aware information is an unresolved problem. To solve these issues, we first propose context-aware dynamic word embedding (CDWE), which could simultaneously consider general meanings, domain-specific meanings, and the context information of words. Based on CDWE, we propose an attention-based convolution neural network, called ADWE-CNN for ATE, which could adaptively capture the previous meanings of words by utilizing an attention mechanism to assign different importance to the respective embeddings. The experimental results show that ADWE-CNN achieves a comparable performance with the state-of-the-art approaches. Various ablation studies have been conducted to explore the benefit of each component. Our code is publicly available at http://github.com/xiejiajia2018/ADWE-CNN.

Keywords:

Aspect term extraction

attention mechanism

sentiment analysis

word embedding

Context-Aware Dynamic Word Embeddings for Aspect Term Extraction

Abstract

Journal

Organization