arrow
Return

Detecting concept change in dynamic data streams

delete2014-01-11
delete77
delete
OA
AI
R
Russel Pears
S
Sripirakas Sakthithasan
Y
Yun Sing Koh *
DOI:10.1007/s10994-013-5433-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this research we present a novel approach to the concept change detection problem. Change detection is a fundamental issue with data stream mining as classification models generated need to be updated when significant changes in the underlying data distribution occur. A number of change detection approaches have been proposed but they all suffer from limitations with respect to one or more key performance factors such as high computational complexity, poor sensitivity to gradual change, or the opposite problem of high false positive rate. Our approach uses reservoir sampling to build a sequential change detection model that offers statistically sound guarantees on false positive and false negative rates but has much smaller computational complexity than the ADWIN concept drift detector. Extensive experimentation on a wide variety of datasets reveals that the scheme also has a smaller false detection rate while maintaining a competitive true detection rate to ADWIN.
Keywords:
Concept drift detection
Data stream mining
Sequential hypothesis testing
Reservoir sampling

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

U
University of Auckland
Scholars:
2.3W
Papers: 2.4W
Citations: 3.3W
A
Auckland University of Technology
Scholars:
4.0K
Papers: 4.4K
Citations: 4.7K