Active deep learning method for semi-supervised sentiment classification

Shusen Zhou

doi:10.1016/j.neucom.2013.04.017

Return

Active deep learning method for semi-supervised sentiment classification

2013-11-01

110

PRE

Shusen Zhou *

陈

陈清财 (Qingcai Chen)

Xiaolong Wang (Xiaolong Wang)

DOI：10.1016/j.neucom.2013.04.017

Original

Original request for help

Save

Abstract

En 中文

In natural language processing community, sentiment classification based on insufficient labeled data is a well-known challenging problem. In this paper, a novel semi-supervised learning algorithm called active deep network (ADN) is proposed to address this problem. First, we propose the semi-supervised learning framework of ADN. ADN is constructed by restricted Boltzmann machines (RBM) with unsupervised learning based on labeled reviews and abundant of unlabeled reviews. Then the constructed structure is fine-tuned by gradient-descent based supervised learning with an exponential loss function. Second, in the semi-supervised learning framework, we apply active learning to identify reviews that should be labeled as training data, then using the selected labeled reviews and all unlabeled reviews to train ADN architecture. Moreover, we combine the information density with ADN, and propose information ADN (IADN) method, which can apply the information density of all unlabeled reviews in choosing the manual labeled reviews. Experiments on five sentiment classification datasets show that ADN and IADN outperform classical semi-supervised learning algorithms, and deep learning techniques applied for sentiment classification. (c) 2013 Elsevier B.V. All rights reserved.

Keywords:

Neural networks

Deep learning

Active learning

Sentiment classification