arrow
Return

A Drift Region-Based Data Sample Filtering Method

delete2022-09-01
delete10
PRE
AI
F
Fan Dong
J
Jie Lü *
Y
Yiliao Song
F
Feng Liu
张广泉 (Guangquan Zhang)
DOI:10.1109/TCYB.2021.3051406delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Concept drift refers to changes in the underlying data distribution of data streams over time. A well-trained model will be outdated if concept drift occurs. Once concept drift is detected, it is necessary to understand where the drift occurs to support the drift adaptation strategy and effectively update the outdated models. This process, called drift understanding, has rarely been studied in this area. To fill this gap, this article develops a drift region-based data sample filtering method to update the obsolete model and track the new data pattern accurately. The proposed method can effectively identify the drift region and utilize information on the drift region to filter the data sample for training models. The theoretical proof guarantees the identified drift region converges uniformly to the real drift region as the sample size increases. Experimental evaluations based on four synthetic datasets and two real-world datasets demonstrate our method improves the learning accuracy when dealing with data streams involving concept drift.
Keywords:
Data models
Adaptation models
Monitoring
Predictive models
Decision trees
Machine learning
Filtering
Concept drift
data stream
machine learning
nonstationary environment
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25