Online entropy-based discretization for data streaming classification

doi:10.1016/j.future.2018.03.008

Return

Online entropy-based discretization for data streaming classification

2018-09-01

PRE

Sergio Ramírez‐Gallego *

Salvador García

Francisco Herrera

DOI：10.1016/j.future.2018.03.008

Original

Original request for help

Save

Abstract

En 中文

Data quality is deemed as determinant in the knowledge extraction process. Low-quality data normally imply low-quality models and decisions. Discretization, as part of data preprocessing, is considered one of the most relevant techniques for improving data quality. In static discretization, output intervals are generated at once, and maintained along the whole process. However, many contemporary problems demands rapid approaches capable of self-adapting their discretization schemes to an ever-changing nature. Other major issues for stream-based discretization such as interval definition, labeling or how is implemented the interaction between learning and discretization components are also discussed in this paper. In order to address all the aforementioned problems, we propose a novel, online and self-adaptive discretization solution for streaming classification which aims at reducing the negative impact of fluctuations in evolving intervals. Experiments with a long list of standard streaming datasets and discretizers have demonstrated that our proposal performs significantly more accurately than the other alternatives. In addition, our scheme is able to leverage from class information without incurring in an overweight cost, being ranked as one of the most rapid supervised options. (C) 2018 Elsevier B.V. All rights reserved.

Keywords:

Data stream

Concept drift

Data preprocessing

Data reduction

Discretization

Online learning

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.