arrow
返回

Adaptive PCA-based feature drift detection using statistical measure

delete2022-08-05
delete7
PRE
AI
A
Anil Kumar Singh
DOI:10.1007/s10586-022-03695-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The plethora of existing methods in the streaming environment is sensitive to extensive and high-dimensional data. The distribution of these streaming data may change concerning time, known as concept drift. Several drift detectors are built to identify the drift near its occurrence point. Still, they lack proper attention to determine the feature relevance change over time, known as feature drift. Over time, the distribution change of the relevant features subset or the change in the relevant features subset itself may cause feature drift in the data stream. The paper proposes an adaptive principal component analysis based feature drift detection method (PCA-FDD) using the statistical measure to determine the feature drift. The proposed work presents a framework for identifying the most important features subset, feature drift, and incremental adaptation of the prediction model. The proposed method finds the relevant features subset by utilizing the incremental PCA and detects feature drift by observing the change in the percentage similarities among the most important features subset with respect to time. It also helps to forecast the prediction error of the base learning model. The proposed method is compared with state-of-the-art methods using synthetic and real-time datasets. The evaluation results exhibit that the proposed work performs better than the existing compared methods in terms of classification accuracy.
Keyword:
Data stream
Principal component analysis (PCA)
Feature drift
Concept drift
Prediction model

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

N
national institute of technology (nit system)
学者数:
4.0W
论文数: 3.7W
被引数: 31
引用论文

引用论文

A survey on feature drift adaptation: Definition, benchmark, challenges and future directions
err2017-05-01
err77
errOAAI
errBarddal, Jean Paul; Gomes, Heitor Murilo; Enembreck, Fabricio; Pfahringer, Bernhard
err分享
err收藏
Assessment and comparison of three different air quality indices in China
err2017-07-04
err0
errOAAI
errYouping Li; Ya Tang; Zhongyu Fan; Hong Zhou; Zhengzheng Yang
err分享
err收藏
OFS-Density: A novel online streaming feature selection method
err2019-02-01
err70
errOAAI
errZhou, Peng; Hu, Xuegang; Li, Peipei; Wu, Xindong
err分享
err收藏
Potential use of alluvial clays from Monoun in ceramics by adding feldspar from Batie (West-Cameroon) as a fluxing agent
err2021-11-06
err0
errOAAI
errGervaise Kieufack; Isaac Yannick Bomeni; François Ngapgue; Arlin Bruno Tchamba; Michel Bertrand Mbog; Serge Tchounang Kouonang; Armand Sylvain Ludovic Wouatong
err分享
err收藏
Recursive PCA for adaptive process monitoring
err2000-10-01
err748
PREAI
errLi, WH; Yue, HH; Valle-Cervantes, S; Qin, SJ
err分享
err收藏
Merit-guided dynamic feature selection filter for data streams优值指导的数据流动态特征选择滤波器
err2019-02-01
err30
PREAI
errBarddal, Jean Paul; Enembreck, Fabricio; Gomes, Heitor Murilo; Bifet, Albert; Pfahringer, Bernhard
err分享
err收藏
学者 查看更多内容