arrow
返回

Detecting group concept drift from multiple data streams

delete2023-02-01
delete33
PRE
AI
H
Hang Yu
W
Weixu Liu
J
Jie Lü *
Y
Yimin Wen
X
Xiangfeng Luo
张
张广泉 (Guangquan Zhang)
DOI:10.1016/j.patcog.2022.109113delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Concept drift may lead to a sharp downturn in the performance of streaming in data-based algorithms, caused by unforeseeable changes in the underlying distribution of data. In this paper, we are mainly concerned with concept drift across multiple data streams, and in situations where the drift of each data stream cannot be detected in time, due to slight underlying distribution drifts. We call this group concept drift. When compared to the detection of concept drift for a single data stream, the challenges of detecting group concept drift arise from three aspects: first, the training data become more complex; second, the underlying distribution becomes more complex; and third, the correlations between data streams become more complex. To address these challenges, the key idea of our method is to construct a distribution free test statistic, free from any underlying distribution in multiple data streams. Then, for streaming data, we design an online learning algorithm to obtain this test statistic, thereby determining the concept drift caused by the hypothesis test. The experiment evaluations with both synthetic and realworld datasets prove that our method can accurately detect concept drift from multiple data streams.(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Concept drift
Data streams
Online learning
Hypothesis test

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
G
Guilin University of Electronic Technology
学者数:
7.4K
论文数: 5.2K
被引数: 5.4K
S
shanghai university
学者数:
3.9W
论文数: 2.7W
被引数: 52
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Marine reservoir corrections for the Caribbean demonstrate high intra- and inter-island variability in local reservoir offsets
err2021-02-01
err0
errOAAI
errRobert J. DiNapoli; Scott M. Fitzpatrick; Matthew F. Napolitano; Torben C. Rick; Jessica H. Stone; Nicholas P. Jew
err分享
err收藏
Data Stream Clustering: A Survey
err2013-07-11
err386
errOAAI
errSilva, Jonathan A.; Faria, Elaine R.; Barros, Rodrigo C.; Hruschka, Eduardo R.; de Carvalho, Andre C. P. L. F.; Gama, Joao
err分享
err收藏
Elastic gradient boosting decision tree with adaptive iterations for concept drift adaptation
err2022-06-01
err24
PREAI
errWang, Kun; Lu, Jie; Liu, Anjin; Song, Yiliao; Xiong, Li; Zhang, Guangquan
err分享
err收藏
Diet of the prehistoric population of Rapa Nui (Easter Island, Chile) shows environmental adaptation and resilience
err2017-06-30
err0
errOAAI
errCatrine L. Jarman; Thomas Larsen; Terry Hunt; Carl Lipo; Reidar Solsvik; Natalie Wallsgrove; Cassie Ka'apu‐Lyons; Hilary G. Close; Brian N. Popp
err分享
err收藏
err分享
err收藏
学者 查看更多内容