An automated text categorization framework based on hyperparameter optimization

Eric S. Téllez

doi:10.1016/j.knosys.2018.03.003

2018-06-01

Eric S. Téllez

Daniela Moctezuma *

Sabino Miranda‐Jiménez

Mario Graff

DOI：10.1016/j.knosys.2018.03.003

原文链接

查看原文

摘要

En 中文

A great variety of text tasks such as topic or spam identification, user profiling, and sentiment analysis can be posed as a supervised learning problem and tackled using a text classifier. A text classifier consists of several subprocesses, some of them are general enough to be applied to any supervised learning problem, whereas others are specifically designed to tackle a particular task using complex and computational expensive processes such as lemmatization, syntactic analysis, etc. Contrary to traditional approaches, we propose a minimalist and multi-propose text-classifier able to tackle tasks independently of domain and language. We named our approach, mu TC. Our approach is composed of several easy-to-implement text transformations, text representations, and a supervised learning algorithm. These pieces produce a competitive classifier in several challenging domains such as informally written text. We provide a detailed description of mu TC along with an extensive experimental comparison with relevant state-of-the-art methods, i.e., mu TC was compared on 30 different datasets. Regarding accuracy, mu TC obtained the best performance in 20 datasets while achieves competitive results in the remaining ones. The compared datasets include several problems like topic and polarity classification, spam detection, user profiling and authorship attribution. Furthermore, our approach allows the usage of the technology even without an in-depth knowledge of machine learning and natural language processing. (C) 2018 Elsevier B.V. All rights reserved.

Keyword:

Text classification

Hyperparameter optimization

Text modelling