返回
Transfer Learning for Sentiment Analysis Using BERT Based Supervised Fine-Tuning
DOI:10.3390/s22114157.png)
摘要
En 中文
The growth of the Internet has expanded the amount of data expressed by users across multiple platforms. The availability of these different worldviews and individuals' emotions empowers sentiment analysis. However, sentiment analysis becomes even more challenging due to a scarcity of standardized labeled data in the Bangla NLP domain. The majority of the existing Bangla research has relied on models of deep learning that significantly focus on context-independent word embeddings, such as Word2Vec, GloVe, and fastText, in which each word has a fixed representation irrespective of its context. Meanwhile, context-based pre-trained language models such as BERT have recently revolutionized the state of natural language processing. In this work, we utilized BERT's transfer learning ability to a deep integrated model CNN-BiLSTM for enhanced performance of decision-making in sentiment analysis. In addition, we also introduced the ability of transfer learning to classical machine learning algorithms for the performance comparison of CNN-BiLSTM. Additionally, we explore various word embedding techniques, such as Word2Vec, GloVe, and fastText, and compare their performance to the BERT transfer learning strategy. As a result, we have shown a state-of-the-art binary classification performance for Bangla sentiment analysis that significantly outperforms all embedding and algorithms.
Keyword:
sentiment analysis
Bangla-BERT
transfer learning
transformer
word embedding
Bangla NLP
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
A hybrid Persian sentiment analysis framework: Integrating dependency grammar based rules and deep neural networks混合波斯语情感分析框架: 基于依赖语法的规则和深度神经网络的集成
NEUROCOMPUTING
IF6.5
Peripheral Artery Disease Is Associated with a Deficiency of Erythrocyte Membrane n‐3 Polyunsaturated Fatty Acids
Lipids
IF0


