arrow
返回

Type-LDD: A Type-Driven Lite Concept Drift Detector for Data Streams

delete2024-12-01
delete2
PRE
AI
H
Hang Yu
J
Jinpeng Li
J
Jie Lü *
Y
Yiliao Song
S
Shaorong Xie
张
张广泉 (Guangquan Zhang)
DOI:10.1109/TKDE.2023.3344602delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Concept drift is a phenomenon that the distribution of data streams changes with time. When this happens, model predictions become less accurate. Hence, concept drift needs to be detected and adapted. Existing drift detection methods are good at determining when drift has occurred, but few retrieve information about how the drift came to be present in the stream, i.e., what type of drift has occurred. Hence, discussing the impact of the type of drift on adaptation is a difficult thing. To fill this gap, we propose a pre-trained framework for training a drift detector called a type-driven lite concept drift detector (Type-LDD) that retrieves information about both when and how a drift has occurred. In our proposed pre-trained framework, the Type-LDD including a drift-type identifier and a drift-point locator was based on a synthetic dataset containing a range of drift types. When repurposing the pre-trained model for detecting new data streams, a knowledge distillation module fine-tunes the proposed Type-LDD to speed up inference and keep detection accuracy. The proposed Type-LDD is validated on both synthetic data and real-world data, and demonstrated that accurately identifying the type of drift that has occurred can improve adaptation accuracy.
Keyword:
Streams
Error analysis
Detectors
Data models
Adaptation models
Symbols
Feature extraction
Concept drift
data streams
knowledge distillation
prototypical network

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
S
shanghai university
学者数:
3.9W
论文数: 2.7W
被引数: 52
引用论文

引用论文

Developmental brain changes during puberty and associations with mental health problems
err2023-04-01
err0
errOAAI
errNiousha Dehestani; Sarah Whittle; Nandita Vijayakumar; Timothy J. Silk
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
What Makes a Better Annuity?
err2009-01-01
err0
errOAAI
errJason S. Scott; John G. Watson; Wei-Yin Hu
err分享
err收藏
A comparative study on concept drift detectors概念漂移探测器的比较研究
err2014-12-01
err115
PREAI
errGoncalves, Paulo M., Jr.; de Carvalho Santos, Silas G. T.; Barros, Roberto S. M.; Vieira, Davi C. L.
err分享
err收藏
err分享
err收藏
A Survey on Concept Drift Adaptation概念漂移适应研究综述
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
err分享
err收藏
Learning under Concept Drift: A Review
err2018-01-01
err922
errOAAI
errLu, Jie; Liu, Anjin; Dong, Fan; Gu, Feng; Gama, Joao; Zhang, Guangquan
err分享
err收藏
学者 查看更多内容