arrow
返回

TS-DM: A Time Segmentation-Based Data Stream Learning Method for Concept Drift Adaptation

delete2024-10-01
delete2
PRE
AI
K
Kun Wang
J
Jie Lü *
A
Anjin Liu
张
张广泉 (Guangquan Zhang)
DOI:10.1109/TCYB.2024.3429459delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Concept drift arises from the uncertainty of data distribution over time and is common in data stream. While numerous methods have been developed to assist machine learning models in adapting to such changeable data, the problem of improperly keeping or discarding data samples remains. This may results in the loss of valuable knowledge that could be utilized in subsequent time points, ultimately affecting the model's accuracy. To address this issue, a novel method called time segmentation-based data stream learning method (TS-DM) is developed to help segment and learn the streaming data for concept drift adaptation. First, a chunk-based segmentation strategy is given to segment normal and drift chunks. Building upon this, a chunk-based evolving segmentation (CES) strategy is proposed to mine and segment the data chunk when both old and new concepts coexist. Furthermore, a warning level data segmentation process (CES-W) and a high-low-drift tradeoff handling process are developed to enhance the generalization and robustness. To evaluate the performance and efficiency of our proposed method, we conduct experiments on both synthetic and real-world datasets. By comparing the results with several state-of-the-art data stream learning methods, the experimental findings demonstrate the efficiency of the proposed method.
Keyword:
Concept drift
Data models
Adaptation models
Time series analysis
Task analysis
Learning systems
Robustness
data stream
ensemble learning
time segmentation

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
引用论文

引用论文

A Drift Region-Based Data Sample Filtering Method
err2022-09-01
err10
PREAI
errDong, Fan; Lu, Jie; Song, Yiliao; Liu, Feng; Zhang, Guangquan
err分享
err收藏
How to design the fair experimental classifier evaluation如何设计公平的实验分类器评价
err2021-06-01
err51
PREAI
errStapor, Katarzyna; Ksieniewicz, Pawel; Garcia, Salvador; Wozniak, Michal
err分享
err收藏
A Survey on Concept Drift Adaptation概念漂移适应研究综述
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
err分享
err收藏
Graph Ensemble Boosting for Imbalanced Noisy Graph Stream Classification
err2015-05-01
err69
errOAAI
errPan, Shirui; Wu, Jia; Zhu, Xingquan; Zhang, Chengqi
err分享
err收藏
Ensemble learning for data stream analysis: A survey用于数据流分析的集成学习: 综述
err2017-09-01
err672
errOAAI
errKrawczyk, Bartosz; Minku, Leandro L.; Gama, Joao; Stefanowski, Jerzy; Wozniak, Michal
err分享
err收藏
学者 查看更多内容