arrow
Return

Multi-Domain Aspect Extraction Using Bidirectional Encoder Representations From Transformers

delete2021-01-01
delete9
delete
OA
AI
B
Brucce Neves dos Santos *
R
Ricardo Marcondes Marcacini
S
Solange Oliveira Rezende
DOI:10.1109/ACCESS.2021.3089099delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Deep learning and neural language models have obtained state-of-the-art results in aspects extraction tasks, in which the objective is to automatically extract characteristics of products and services that are the target of consumer opinion. However, these methods require a large amount of labeled data to achieve such results. Since data labeling is a costly task, there are no labeled data available for all domains. In this paper, we propose an approach for aspect extraction in a multi-domain transfer learning scenario, thereby leveraging labeled data from different source domains to extract aspects of a new unlabeled target domain. Our approach, called MDAE-BERT (Multi-Domain Aspect Extraction using Bidirectional Encoder Representations from Transformers), explores neural language models to deal with two major challenges in multi-domain learning: (1) inconsistency of aspects from target and source domains and (2) context-based semantic distance between ambiguous aspects. We evaluated our MDAE-BERT considering two perspectives (1) the aspect extraction performance using F1-Macro and Accuracy measures; and (2) by comparing the multi-domain aspect extraction models and single-domain models for aspect extraction. In the first perspective, our method outperforms the LSTM-based approach. In the second perspective, our approach proved to be a competitive alternative compared to the single-domain model trained in a specific domain, even in the absence of labeled data from the target domain.
Keywords:
Sentiment analysis
Data mining
Computer architecture
Microprocessors
Logic gates
Task analysis
Feature extraction
Aspect extraction
multi-domain
BERT
transfer learning

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
universidade de sao paulo
Scholars:
10.6W
Papers: 6.7W
Citations: 93
Cited Papers

Cited Papers

errShare
errSave
Aspect extraction for opinion mining with a deep convolutional neural network
err2016-09-01
err600
PREAI
errPoria, Soujanya; Cambria, Erik; Gelbukh, Alexander
errShare
errSave
YAC transgene-mediated olfactory receptor gene choice
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
errShare
errSave
A late Paleoproterozoic (1.74 Ga) deep‐sea, low‐temperature, iron‐oxidizing microbial hydrothermal vent community from Arizona, USA
err2021-02-16
err0
errOAAI
errCrispin T. S. Little; Karen C. Johannessen; Stefan Bengtson; Clara S. Chan; Magnus Ivarsson; John F. Slack; Curt Broman; Ingunn H. Thorseth; Tor Grenne; Olivier J. Rouxel; Andrey Bekker
errShare
errSave
errShare
errSave
UHRF1 upregulation mediates exosome release and tumor progression in osteosarcoma
err
IF0
err2020-05-25
err0
errOAAI
errStephanie C. Wu; Ahhyun Kim; Loredana Zocchi; Claire Chen; Jocelyne Lopez; Kelsey Salcido; Jie Wu; Claudia A. Benavente
errShare
errSave
A survey of transfer learning
err2016-05-28
err0
errOAAI
errKarl Weiss; Taghi M. Khoshgoftaar; DingDing Wang
errShare
errSave
A Survey on Transfer Learning
err2010-10-01
err1.4W
PREAI
errPan, Sinno Jialin; Yang, Qiang
errShare
errSave
researcher View more