arrow
Return

Concept Drift Detection Delay Index

delete2022-01-01
delete10
delete
OA
AI
A
Anjin Liu
J
Jie Lü *
Y
Yiliao Song
J
Junyu Xuan
张
张广泉 (Guangquan Zhang)
DOI:10.1109/TKDE.2022.3153349delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Data streams may encounter data distribution changes, which can significantly impair the accuracy of models. Concept drift detection tracks data distribution changes and signals when to update models. Many drift detection methods apply thresholds to distinguish between drift or non-drift streams and to claim their method outperforms others with non-aligned drift thresholds. We consider that selecting a proper drift threshold could be more important than developing a new drift detection algorithm, and different drift detection algorithms may end up with very similar performance with aligned drift thresholds. To better understand this process, we propose a novel threshold selection algorithm to align the drift thresholds of a set of algorithms so that they are all at the same sensitivity level. Based on comprehensive experiment evaluations, we observed that several state-of-the-art drift detection algorithms could achieve similar results by aligning their thresholds, providing a novel insight to explain how drift detection algorithms contribute to data stream learning. We noticed that a higher detection sensitivity improves accuracy for data streams with frequent distribution change. The evaluation results are showing that drift thresholds should not be fixed during stream learning. Rather, they should adjust dynamically based on the prevailing conditions of the data stream.
Keywords:
Detection algorithms
Error analysis
Indexes
Robustness
Training
Monitoring
Data models
Data stream
data mining
concept drift
machine learning

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
Cited Papers

Cited Papers

A Survey on Ensemble Learning for Data Stream Classification
err2017-03-27
err378
PREAI
errGomes, Heitor Murilo; Barddal, Jean Paul; Enembreck, Fabricio; Bifet, Albert
errShare
errSave
A unifying view on dataset shift in classification
err2012-01-01
err611
PREAI
errMoreno-Torres, Jose G.; Raeder, Troy; Alaiz-Rodriguez, Rocio; Chawla, Nitesh V.; Herrera, Francisco
errShare
errSave
FFT-LB Modeling of Thermal Liquid-Vapor System
err2012-04-19
err0
errOAAI
errYan-Biao Gan; Ai-Guo Xu; Guang-Cai Zhang; Ying-Jun Li
errShare
errSave
A Survey on Concept Drift Adaptation
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
errShare
errSave
Learning under Concept Drift: A Review
err2018-01-01
err922
errOAAI
errLu, Jie; Liu, Anjin; Dong, Fan; Gu, Feng; Gama, Joao; Zhang, Guangquan
errShare
errSave
Reactive Soft Prototype Computing for Concept Drift Streams
err2020-11-01
err76
errOAAI
errRaab, Christoph; Heusinger, Moritz; Schleif, Frank-Michael
errShare
errSave
Learning in Nonstationary Environments: A Survey
err2015-11-01
err569
errOAAI
errDitzler, Gregory; Roveri, Manuel; Alippi, Cesare; Polikar, Robi
errShare
errSave
errShare
errSave
Online and Non-Parametric Drift Detection Methods Based on Hoeffding's Bounds
err2015-03-01
err278
errOAAI
errFrias-Blanco, Isvani; del Campo-Avila, Jose; Ramos-Jimenez, Gonzalo; Morales-Bueno, Rafael; Ortiz-Diaz, Agustin; Caballero-Mota, Yaile
errShare
errSave
researcher View more