arrow
Return

The online performance estimation framework: heterogeneous ensemble learning for data streams

delete2017-12-21
delete83
delete
OA
AI
J
Jan N. van Rijn *
G
Geoffrey Holmes
B
Bernhard Pfahringer
J
Joaquin Vanschoren
DOI:10.1007/s10994-017-5686-9delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Ensembles of classifiers are among the best performing classifiers available in many data mining applications, including the mining of data streams. Rather than training one classifier, multiple classifiers are trained, and their predictions are combined according to a given voting schedule. An important prerequisite for ensembles to be successful is that the individual models are diverse. One way to vastly increase the diversity among the models is to build an heterogeneous ensemble, comprised of fundamentally different model types. However, most ensembles developed specifically for the dynamic data stream setting rely on only one type of base-level classifier, most often Hoeffding Trees. We study the use of heterogeneous ensembles for data streams. We introduce the Online Performance Estimation framework, which dynamically weights the votes of individual classifiers in an ensemble. Using an internal evaluation on recent training data, it measures how well ensemble members performed on this and dynamically updates their weights. Experiments over a wide range of data streams show performance that is competitive with state of the art ensemble techniques, including Online Bagging and Leveraging Bagging, while being significantly faster. All experimental results from this work are easily reproducible and publicly available online.
Keywords:
Data streams
Ensembles
Meta-learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

U
University of Waikato
Scholars:
2.9K
Papers: 3.4K
Citations: 4.6K
U
University of Freiburg
Scholars:
3.3W
Papers: 2.4W
Citations: 3.4W
L
Leiden University
Scholars:
4.0W
Papers: 3.3W
Citations: 3.8W
researcher View more organizations
Cited Papers

Cited Papers

Assessment and comparison of three different air quality indices in China
err2017-07-04
err0
errOAAI
errYouping Li; Ya Tang; Zhongyu Fan; Hong Zhou; Zhengzheng Yang
errShare
errSave
MetaStream: A meta-learning based method for periodic algorithm selection in time-changing data
err2014-03-01
err66
PREAI
errDebiaso Rossi, Andre Luis; de Leon Ferreira de Carvalho, Andre Carlos Ponce; Soares, Carlos; de Souza, Bruno Feres
errShare
errSave
On evaluating stream learning algorithms
err2012-10-24
err360
errOAAI
errGama, Joao; Sebastiao, Raquel; Rodrigues, Pedro Pereira
errShare
errSave
errShare
errSave
researcher View more