Vertical Ensemble Co-Training for Text Classification

doi:10.1145/3137114

Vertical Ensemble Co-Training for Text Classification

2017-10-25

13

PRE

AI

DOI：10.1145/3137114

Original request for help

Save

Abstract

En 中文

High-quality, labeled data is essential for successfully applying machine learning methods to real-world text classification problems. However, in many cases, the amount of labeled data is very small compared to that of the unlabeled, and labeling additional samples could be expensive and time consuming. Co-training algorithms, which make use of unlabeled data to improve classification, have proven to be very effective in such cases. Generally, co-training algorithms work by using two classifiers, trained on two different views of the data, to label large amounts of unlabeled data. Doing so can help minimize the human effort required for labeling new data, as well as improve classification performance. In this article, we propose an ensemble-based co-training approach that uses an ensemble of classifiers from different training iterations to improve labeling accuracy. This approach, which we call vertical ensemble, incurs almost no additional computational cost. Experiments conducted on six textual datasets show a significant improvement of over 45% in AUC compared with the original co-training algorithm.

Keywords:

Co-training

text classification

ensemble

Vertical Ensemble Co-Training for Text Classification

Abstract

AI Summary

Journal

Organization