arrow
Return

Active deep learning method for semi-supervised sentiment classification

delete2013-11-01
delete110
PRE
AI
S
Shusen Zhou *
陈清财 (Qingcai Chen)
X
Xiaolong Wang
DOI:10.1016/j.neucom.2013.04.017delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In natural language processing community, sentiment classification based on insufficient labeled data is a well-known challenging problem. In this paper, a novel semi-supervised learning algorithm called active deep network (ADN) is proposed to address this problem. First, we propose the semi-supervised learning framework of ADN. ADN is constructed by restricted Boltzmann machines (RBM) with unsupervised learning based on labeled reviews and abundant of unlabeled reviews. Then the constructed structure is fine-tuned by gradient-descent based supervised learning with an exponential loss function. Second, in the semi-supervised learning framework, we apply active learning to identify reviews that should be labeled as training data, then using the selected labeled reviews and all unlabeled reviews to train ADN architecture. Moreover, we combine the information density with ADN, and propose information ADN (IADN) method, which can apply the information density of all unlabeled reviews in choosing the manual labeled reviews. Experiments on five sentiment classification datasets show that ADN and IADN outperform classical semi-supervised learning algorithms, and deep learning techniques applied for sentiment classification. (c) 2013 Elsevier B.V. All rights reserved.
Keywords:
Neural networks
Deep learning
Active learning
Sentiment classification

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

L
Ludong University
Scholars:
5.6K
Papers: 3.3K
Citations: 3.7K
H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66