arrow
返回

Concept Drift Detection Delay Index

delete2022-01-01
delete10
delete
OA
AI
A
Anjin Liu
J
Jie Lü *
Y
Yiliao Song
J
Junyu Xuan
张广泉 (Guangquan Zhang)
DOI:10.1109/TKDE.2022.3153349delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data streams may encounter data distribution changes, which can significantly impair the accuracy of models. Concept drift detection tracks data distribution changes and signals when to update models. Many drift detection methods apply thresholds to distinguish between drift or non-drift streams and to claim their method outperforms others with non-aligned drift thresholds. We consider that selecting a proper drift threshold could be more important than developing a new drift detection algorithm, and different drift detection algorithms may end up with very similar performance with aligned drift thresholds. To better understand this process, we propose a novel threshold selection algorithm to align the drift thresholds of a set of algorithms so that they are all at the same sensitivity level. Based on comprehensive experiment evaluations, we observed that several state-of-the-art drift detection algorithms could achieve similar results by aligning their thresholds, providing a novel insight to explain how drift detection algorithms contribute to data stream learning. We noticed that a higher detection sensitivity improves accuracy for data streams with frequent distribution change. The evaluation results are showing that drift thresholds should not be fixed during stream learning. Rather, they should adjust dynamically based on the prevailing conditions of the data stream.
Keyword:
Detection algorithms
Error analysis
Indexes
Robustness
Training
Monitoring
Data models
Data stream
data mining
concept drift
machine learning

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
引用论文

引用论文

A Survey on Ensemble Learning for Data Stream Classification面向数据流分类的集成学习研究综述
err2017-03-27
err378
PREAI
errGomes, Heitor Murilo; Barddal, Jean Paul; Enembreck, Fabricio; Bifet, Albert
err分享
err收藏
A unifying view on dataset shift in classification关于分类中数据集移位的统一观点
err2012-01-01
err611
PREAI
errMoreno-Torres, Jose G.; Raeder, Troy; Alaiz-Rodriguez, Rocio; Chawla, Nitesh V.; Herrera, Francisco
err分享
err收藏
FFT-LB Modeling of Thermal Liquid-Vapor System
err2012-04-19
err0
errOAAI
errYan-Biao Gan; Ai-Guo Xu; Guang-Cai Zhang; Ying-Jun Li
err分享
err收藏
A Survey on Concept Drift Adaptation概念漂移适应研究综述
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
err分享
err收藏
Learning under Concept Drift: A Review
err2018-01-01
err922
errOAAI
errLu, Jie; Liu, Anjin; Dong, Fan; Gu, Feng; Gama, Joao; Zhang, Guangquan
err分享
err收藏
Reactive Soft Prototype Computing for Concept Drift Streams
err2020-11-01
err76
errOAAI
errRaab, Christoph; Heusinger, Moritz; Schleif, Frank-Michael
err分享
err收藏
Learning in Nonstationary Environments: A Survey
err2015-11-01
err569
errOAAI
errDitzler, Gregory; Roveri, Manuel; Alippi, Cesare; Polikar, Robi
err分享
err收藏
err分享
err收藏
Online and Non-Parametric Drift Detection Methods Based on Hoeffding's Bounds
err2015-03-01
err278
errOAAI
errFrias-Blanco, Isvani; del Campo-Avila, Jose; Ramos-Jimenez, Gonzalo; Morales-Bueno, Rafael; Ortiz-Diaz, Agustin; Caballero-Mota, Yaile
err分享
err收藏
学者 查看更多内容