arrow
Return

Hierarchical Reduced-Space Drift Detection Framework for Multivariate Supervised Data Streams

delete2021-01-01
delete1
delete
OA
AI
S
Shuyi Zhang *
P
Peter Tiňo
X
Xin Yao
DOI:10.1109/TKDE.2021.3111756delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In a streaming environment, the characteristics of the data themselves and their relationship with the labels may change over time. Most drift detection methods for supervised data streams are performance-based, that is, they detect changes only after the classification accuracy deteriorates. This may not be sufficient in many application areas where the reason behind a drift is also important. Another category of drift detectors are data distribution-based detectors. Although they can detect some drifts within the input space, changes affecting only the labelling mechanism cannot be identified. Furthermore, little work is available on drift detection for high-dimensional data streams. In this paper we propose an advanced Hierarchical Reduced-space Drift Detection (HRDD) framework for supervised data streams which captures drifts regardless of their effects on classification performance. This framework suggests monitoring both marginal and class-conditional distributions within a lower-dimensional space specifically relevant to the assigned classification task. Experimental comparisons have demonstrated that HRDD not only achieves high-quality performance on high-dimensional data streams, but also outperforms its competitors in terms of detection recall, precision and F-measure across a wide range of different concept drift types including subtle drifts.
Keywords:
Detectors
Monitoring
Training
Task analysis
Licenses
Feature extraction
Delays
Concept drift
drift detection
data stream mining
online learning

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.7K
Citations:
3.2W

Organization

U
University of Birmingham
Scholars:
4.1W
Papers: 3.8W
Citations: 5.0W