.png){kind=icon}
.png){kind=icon}
Return
Type-LDD: A Type-Driven Lite Concept Drift Detector for Data Streams
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2023.3344602.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Concept drift is a phenomenon that the distribution of data streams changes with time. When this happens, model predictions become less accurate. Hence, concept drift needs to be detected and adapted. Existing drift detection methods are good at determining when drift has occurred, but few retrieve information about how the drift came to be present in the stream, i.e., what type of drift has occurred. Hence, discussing the impact of the type of drift on adaptation is a difficult thing. To fill this gap, we propose a pre-trained framework for training a drift detector called a type-driven lite concept drift detector (Type-LDD) that retrieves information about both when and how a drift has occurred. In our proposed pre-trained framework, the Type-LDD including a drift-type identifier and a drift-point locator was based on a synthetic dataset containing a range of drift types. When repurposing the pre-trained model for detecting new data streams, a knowledge distillation module fine-tunes the proposed Type-LDD to speed up inference and keep detection accuracy. The proposed Type-LDD is validated on both synthetic data and real-world data, and demonstrated that accurately identifying the type of drift that has occurred can improve adaptation accuracy.
Keywords:
Streams
Error analysis
Detectors
Data models
Adaptation models
Symbols
Feature extraction
Concept drift
data streams
knowledge distillation
prototypical network
Journal
IF:
10.4
Papers:
6.8K
Citations:
3.2W