arrow
返回

Correlation-based feature partition regression method for unsupervised anomaly detection

delete2022-03-11
delete3
PRE
AI
Z
Zhiyu Liu
X
Xin Gao *
X
Xin Jia
B
Bing Xue
S
Shiyuan Fu
K
Kangsheng Li
X
Xu Huang
Z
Zijian Huang
DOI:10.1007/s10489-022-03247-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Anomaly detection problem has been extensively studied in a variety of application domains, where the data tags are difficult to obtain. Most unsupervised algorithms rely on some notions such as distance and density to detect anomalies. However, the performance of such algorithms is easier to decrease as the dimension of the datasets increases. Some studies which use features as pseudo-labels for prediction detect anomalies according to the deviation value of the prediction model. Even so, the improvement of model performance is still restricted to ignoring the correlation between feature attributes. In this paper, we propose a correlation-based feature partition regression prediction method called CFPR, which can alleviate the adverse effects of dataset dimensions and irrelevant attributes on model performance to a certain extent. According to the correlation between the features, the high-dimensional datasets will be divided into multiple feature subspaces. In each subspace, the feature with the highest correlation coefficient will be conducted as a pseudo-label. After that, we use the remaining features as the prediction attributes to train a supervised regression prediction model. We can calculate the anomaly score of each sample in the subspace according to the difference between the regression prediction value and the true value of the pseudo-label. Furthermore, we define a weighting strategy based on the level of correlation in the subspace integration stage to obtain the final anomaly score ranking table. Extensive experiments on twenty-eight UCI public datasets show that the CFPR performs better than several state-of-art anomaly algorithms at the AUC metric.
Keyword:
Unsupervised anomaly detection
Pseudo labeling
Feature correlation partition
Weighted regression predict

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
引用论文

引用论文

Dynamic imposter based online instance matching for person search
err2020-04-01
err19
PREAI
errDai, Ju; Zhang, Pingping; Lu, Huchuan; Wang, Hongyu
err分享
err收藏
A local-gravitation-based method for the detection of outliers and boundary points
err2020-03-01
err32
PREAI
errXie, Jiang; Xiong, Zhongyang; Dai, Qizhu; Wang, Xiaoxia; Zhang, Yufang
err分享
err收藏
A multi-measure feature selection algorithm for efficacious intrusion detection
err2021-09-01
err16
PREAI
errHerrera-Semenets, Vitali; Bustio-Martinez, Lazaro; Hernandez-Leon, Raudel; van den Berg, Jan
err分享
err收藏
Tension control: dancer rolls or load cells
err1993-01-01
err0
PREAI
errN.A. Ebler; R. Arnason; G. Michaelis; N. D'Sa
err分享
err收藏
A promotion method for generation error-based video anomaly detection
err2020-12-01
err15
errOAAI
errWang, Zhiguo; Yang, Zhongliang; Zhang, Yu-Jin
err分享
err收藏
学者 查看更多内容